pub enum Flavour {
Generic,
Vllm,
LlamaCpp,
LmStudio,
}Expand description
Which OpenAI-compatible runtime is on the other end.
Variants§
Generic
Standard fields only. OpenAI answers 400 to a field it does not know, so nothing
runtime-specific can be sent — top_k and min_p included.
Measured behind Ollama’s /v1 on gemma4:26b-a4b-it-q4_K_M: this body returns the same
distribution as the native path with its pinned options, to the third decimal.
Vllm
LlamaCpp
LmStudio
Trait Implementations§
impl Copy for Flavour
impl Eq for Flavour
impl StructuralPartialEq for Flavour
Auto Trait Implementations§
impl Freeze for Flavour
impl RefUnwindSafe for Flavour
impl Send for Flavour
impl Sync for Flavour
impl Unpin for Flavour
impl UnsafeUnpin for Flavour
impl UnwindSafe for Flavour
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more