Expand description
2026-09-28: PolicyPrecision, the EdgePrecision the engine’s own precision answers
give: the checkpoint’s declared plan (DeclaredPrecisionPlan) under the served tier
(WeightQuantPolicy), plus the formats the engine chooses itself (a recipe’s lm_head, the
MTP head), which the checkpoint does not declare.
Owner: metrale-circuit. Invariants:
- Engine formats are stated, never inferred: a module they name is answered from them first, in order; every other module from the policy.
- Under the
declaredtier a module declared FP8 runs its FP8 weights, with FP8 activations exactly whenWeightQuantPolicy::fp8_decode_actsays so; one declared FP4 runs NVFP4 weights, with FP4 activations when the checkpoint declares them. Undernvfp4every quantized module runs NVFP4 weights and 16-bit activations. - An unquantized module is BF16 weights and activations.
Structs§
- Checkpoint
Plan - 2026-09-28: A checkpoint’s
quantization_config, as the circuit fixtures store it (kernels/circuits/checkpoints/<name>.toml). - Policy
Precision - 2026-09-28: The engine’s precision answers as an
EdgePrecision.
Functions§
- caps_
named - 2026-09-28: The kernel capabilities named
names(field names ofKernelCaps). - tier_
named - 2026-09-28: The tier named
name(declared,nvfp4).