pub struct PoolPlan {
pub source: UnitSource,
pub layers: usize,
pub h_f32_unit: usize,
pub h_stored_unit: usize,
pub conv_unit: usize,
pub counts: PoolCounts,
/* private fields */
}Expand description
2026-09-30: The SSM pool of one model, sized.
Fields§
§source: UnitSource2026-09-30: Where the unit sizes came from.
layers: usize2026-09-30: Recurrent layers.
h_f32_unit: usize2026-09-30: One h unit at FP32 width (the prefill staging blob).
h_stored_unit: usize2026-09-30: One h unit as stored (half under --ssm-h-dtype f16-pool).
conv_unit: usize2026-09-30: One conv unit.
counts: PoolCounts2026-09-30: The counts the plan was made for.
Implementations§
Source§impl PoolPlan
impl PoolPlan
Sourcepub fn new(
config: &ModelConfig,
counts: &PoolCounts,
h_f16_pool: bool,
) -> Result<Self>
pub fn new( config: &ModelConfig, counts: &PoolCounts, h_f16_pool: bool, ) -> Result<Self>
2026-09-30: The pool of config holding counts.
Sourcepub fn layer_bytes(&self, state: PoolState, holding: Holding) -> usize
pub fn layer_bytes(&self, state: PoolState, holding: Holding) -> usize
2026-09-30: Bytes one layer holds of state for holding.
Trait Implementations§
Auto Trait Implementations§
impl Freeze for PoolPlan
impl RefUnwindSafe for PoolPlan
impl Send for PoolPlan
impl Sync for PoolPlan
impl Unpin for PoolPlan
impl UnwindSafe for PoolPlan
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more