quantized_v2

Function quantized_v2 

Source
pub fn quantized_v2(
    store: &WeightStore,
    prefix: &str,
    gpu: &dyn GpuBackend,
) -> Result<QuantizedWeight>
Expand description

2026-09-25: Build a QuantizedWeight from compressed-tensors NVFP4 keys: weight_packed, weight_scale, weight_global_scale and an optional input_global_scale. compressed-tensors stores the global scale as the reciprocal of weight_scale_2, so weight_scale_2 = 1 / weight_global_scale.