Expand description
2026-09-26: The seam the serve matrix boots checkpoints through: the serving
process installs a ServeHost, because this crate starts no server.
Owner: bench, serve matrix. Invariants: none beyond the types.
Structs§
- Serve
Candidate - 2026-09-26: One checkpoint the box knows about. Two quants of a model are two candidates, and so two rounds.
- Serve
Options - 2026-09-26: How one round is served.
Enums§
- Absence
- 2026-09-26: Why a cached checkpoint cannot take part in the matrix. An absent checkpoint is skipped and never booted; a planned one that fails to boot fails its round.
Constants§
- NO_HOST
- 2026-09-26: What to tell the operator when nothing is installed;
loadfails with it.
Traits§
- Serve
Host - 2026-09-26: Boots checkpoints and puts the previous one back; implemented by the serving process.