pub struct ModelDims {
pub num_layers: u32,
pub max_blocks_per_layer: u32,
pub num_q_heads: u16,
pub num_kv_heads: u16,
pub head_dim: u16,
pub block_size: u16,
pub model_fp: Option<NonZeroU64>,
}Expand description
2026-09-25: Geometry of the model HighSpeedSwap serves, from
high_speed_swap_dims in metrale-model-engine.
Fields§
§num_layers: u32§max_blocks_per_layer: u32§num_q_heads: u16§num_kv_heads: u16§head_dim: u16§block_size: u16§model_fp: Option<NonZeroU64>2026-09-25: Model fingerprint (ModelFingerprint::derive_kv in
metrale-model-engine), folded into the KV paging namespace by
kv_paging::ns::derive_kv_ns. None when it could not be derived; a
METRALE_KV_PAGING=1 connect then fails unless METRALE_KV_PAGING_NS is set.
Only connect_kv_peer_backend reads it.
Trait Implementations§
Auto Trait Implementations§
impl Freeze for ModelDims
impl RefUnwindSafe for ModelDims
impl Send for ModelDims
impl Sync for ModelDims
impl Unpin for ModelDims
impl UnwindSafe for ModelDims
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more