quantized_any

Function quantized_any 

Source
pub fn quantized_any(
    store: &WeightStore,
    prefix: &str,
    n: usize,
    k: usize,
    gpu: &dyn GpuBackend,
    variant: Nvfp4Variant,
    qctx: QuantizeCtx,
) -> Result<QuantizedWeight>
Expand description

2026-09-25: Load a weight [n, k] as NVFP4 whatever its on-disk format.

The variant is overridden per key: a key with only a .weight is quantized as Bf16Raw, and an FP8E4M3 key with a weight_scale or weight_scale_inv but no NVFP4 global scale is dequantized as Fp8Dequanted (unless variant is already Fp8Dequanted or Bf16Raw). n and k are used only by those two re-quantizing paths.