Struct AppState 

pub struct AppState {
    pub engine: Arc<Engine>,
    pub config: Arc<Config>,
    pub semaphore: Arc<Semaphore>,
}

Fields

engine: Arc<Engine>

config: Arc<Config>

semaphore: Arc<Semaphore>

Caps how many questions are in flight against the host at once.

Ollama serialises beyond its own parallelism setting, so firing an unbounded number of questions at it turns a burst into a queue with no backpressure. A bound keeps the latency of any single request predictable.

Implementations

impl AppState

pub fn new(engine: Engine, config: Config) -> Self

Trait Implementations

impl Clone for AppState

fn clone(&self) -> AppState

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.