pub struct PredictedDerived {
pub attn_fp8_twins: u64,
pub ssm_fp8_concat: u64,
pub ffn_gateup_fused: u64,
pub ffn_gateup_pruned: u64,
pub twins: TwinsBuilt,
pub attn_twin_set: Fp8TwinSet,
}Expand description
2026-09-25: The derived bytes the native-FP8 dense loader will keep, by term.
Fields§
§attn_fp8_twins: u642026-09-25: Fp8Weight::transpose_for_gemm twins for the projections
fp8_residency::DenseFp8Plan selects, summed over full-attention
layers.
ssm_fp8_concat: u642026-09-25: The fused [QKV|Z] FP8 weight, its block-scale grids, the
out_proj block-scale grid and the interleaved in_proj_ba, summed
over linear-attention layers (ssm_concat_bytes).
ffn_gateup_fused: u642026-09-25: The E4M3 bytes of the fused [2*inter, hidden] gate+up
weight, summed over layers; its scale grid is not counted. 0 when the
fusion is not selected.
ffn_gateup_pruned: u642026-09-25: The mlp.gate_proj.weight and mlp.up_proj.weight bytes
that prune_after_load releases on the same layers. Equal to
Self::ffn_gateup_fused: the fused weight is those two tensors side
by side.
twins: TwinsBuilt2026-09-25: Which derived families the prediction expects.
attn_twin_set: Fp8TwinSet2026-09-25: The twin set the attention term was priced at.
Implementations§
Source§impl PredictedDerived
impl PredictedDerived
Sourcepub fn total(&self) -> u64
pub fn total(&self) -> u64
2026-09-25: Derived bytes above the on-disk checkpoint size, which
headroom.rs adds to that size. The fusion enters as a difference,
which is zero: the on-disk size still counts the gate and up tensors
that prune_after_load releases once the fused copy exists
(the_gateup_fusion_is_residency_neutral).
Trait Implementations§
Source§impl Clone for PredictedDerived
impl Clone for PredictedDerived
Source§fn clone(&self) -> PredictedDerived
fn clone(&self) -> PredictedDerived
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read moreSource§impl Debug for PredictedDerived
impl Debug for PredictedDerived
Source§impl Default for PredictedDerived
impl Default for PredictedDerived
Source§fn default() -> PredictedDerived
fn default() -> PredictedDerived
Source§impl PartialEq for PredictedDerived
impl PartialEq for PredictedDerived
impl Copy for PredictedDerived
impl Eq for PredictedDerived
impl StructuralPartialEq for PredictedDerived
Auto Trait Implementations§
impl Freeze for PredictedDerived
impl RefUnwindSafe for PredictedDerived
impl Send for PredictedDerived
impl Sync for PredictedDerived
impl Unpin for PredictedDerived
impl UnwindSafe for PredictedDerived
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
key and return true if they are equal.