nvfp4_bytes

metrale_model_arch::weight_loader::fp8_residency

Function nvfp4_bytes 

Source 
pub fn nvfp4_bytes(n: usize, k: usize) -> usize
Expand description

2026-09-25: Bytes of one NVFP4 QuantizedWeight: n * k / 2 packed E2M1 bytes plus n * k / 16 group-scale bytes, the two allocations of quantize_to_nvfp4 and of QuantizedWeight::transpose_for_gemm_gs with 16-wide groups.