Trait ServeHost 

pub trait ServeHost: Send + Sync {
    // Required methods
    fn roster(&self) -> Result<Vec<ServeCandidate>>;
    fn serve(
        &self,
        model: &str,
        opts: ServeOptions,
    ) -> BoxFuture<'_, Result<TargetEndpoint>>;
    fn restore(&self) -> BoxFuture<'_, Result<()>>;
}

2026-09-26: Boots checkpoints and puts the previous one back; implemented by the serving process.

Required Methods

fn roster(&self) -> Result<Vec<ServeCandidate>>

2026-09-26: Every checkpoint the box holds, each marked servable or absent.

fn serve( &self, model: &str, opts: ServeOptions, ) -> BoxFuture<'_, Result<TargetEndpoint>>

2026-09-26: Bring model up and return the endpoint once it answers.

fn restore(&self) -> BoxFuture<'_, Result<()>>

2026-09-26: Put back whatever was serving before the matrix started. Called from the benchmark’s cleanup once a plan exists.

Implementors