Expand description
2026-09-25: The quantized-weight layout of a checkpoint, and its ignore
list: CompressedTensorsFormat, ModeloptFormat or
Fp8BlockScaledFormat, chosen by detect_quant_format.
Owner: model-layers (weight loading). Invariants: none beyond the types.
Structs§
- Compressed
Tensors Format - 2026-09-25: A compressed-tensors checkpoint.
- Fp8Block
Scaled Format - 2026-09-25: An FP8 block-scaled checkpoint.
- Ignore
List - 2026-09-30: A checkpoint’s ignore list, parsed with the matching rules of its format
(
metrale_config::precision_plan::Target, the matcher the declared precision plan uses): compressed-tensorsre:regexes or exact names, ModelOpt exact names or globs, HFfp8module paths on whole dotted segments. - Modelopt
Format - 2026-09-25: A ModelOpt checkpoint, and the fallback of
super::detect_quant_formatwhen no quantized weights are found.
Traits§
- Quant
Format - 2026-09-25: A quantized-weight layout: its log name, the
Nvfp4Variantit maps to, and the module globs its ignore list keeps unquantized. The weight loaders pick their variant throughweight_map::detect_nvfp4_variant, not through this trait.
Functions§
- detect_
quant_ format - 2026-09-25: Pick the
QuantFormatfor a checkpoint.