predicted_derived_bytes

metrale_model_arch::weight_loader::predicted_residency

Function predicted_derived_bytes 

Source 
pub fn predicted_derived_bytes(
    config: &ModelConfig,
    route: &Fp8RouteInputs,
) -> DerivedBytesEstimate
Expand description

2026-09-25: Bytes the native-FP8 dense loader will derive on top of the checkpoint, or why that is not predicted. Reads only its arguments.