Module host

Module host 

Source
Expand description

2026-09-26: The seam the serve matrix boots checkpoints through: the serving process installs a ServeHost, because this crate starts no server.

Owner: bench, serve matrix. Invariants: none beyond the types.

Structs§

ServeCandidate
2026-09-26: One checkpoint the box knows about. Two quants of a model are two candidates, and so two rounds.
ServeOptions
2026-09-26: How one round is served.

Enums§

Absence
2026-09-26: Why a cached checkpoint cannot take part in the matrix. An absent checkpoint is skipped and never booted; a planned one that fails to boot fails its round.

Constants§

NO_HOST
2026-09-26: What to tell the operator when nothing is installed; load fails with it.

Traits§

ServeHost
2026-09-26: Boots checkpoints and puts the previous one back; implemented by the serving process.

Functions§

install
2026-09-26: The serving process calls this as it starts; a later call replaces the earlier host.
installed