pub struct BuiltModel {
pub model: Box<dyn Model>,
pub max_batch_size: usize,
pub drafter_weights_sha256: Option<String>,
}Expand description
2026-10-01: A built model and the slot count it was built with (the request, or what auto
resolved to), which the scheduler and the serve’s disclosure take from here.
Fields§
§model: Box<dyn Model>§max_batch_size: usize§drafter_weights_sha256: Option<String>2026-10-04: sha256 over the drafter’s stored weights (WeightStore::drafter_weights_sha256),
None for a checkpoint with no mtp.* tensors. The --spec-cost-model measured drafter
key.
Auto Trait Implementations§
impl Freeze for BuiltModel
impl !RefUnwindSafe for BuiltModel
impl Send for BuiltModel
impl Sync for BuiltModel
impl Unpin for BuiltModel
impl !UnwindSafe for BuiltModel
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more