Expand description
2026-09-30: The model source over the checkpoint itself: config.json (and the sidecar
hf_quant_config.json) resolved by crate::resolve_checkpoint at the declared formats,
with the serving policy derived from the checkpoint and the engine’s stated defaults. A
recipe request goes to the recipe’s golden instance (InstancesSource), whose formats
are the recipe’s.
Owner: metrale-circuit (hardware). Invariants:
- Every derived setting names where its value comes from (
POLICY_SOURCES); the class’s[defaults]settings are placeholders here and are always re-read from the device’s class (super::model::policy_on_class). - A checkpoint the model axis refuses is refused here with its reason, never planned from a guess.
Structs§
- Checkpoint
Source - 2026-09-30: The source over checkpoints, falling back to the recipes for
recipeformats.
Constants§
- KERNEL_
QUANT - 2026-09-30: The kernel quant axis every target is built for: the build compiles
METRALE_TARGET_QUANT=nvfp4unless told otherwise, and the FP8 35B-A3B golden instance targetsgb10/qwen3.6-35b-a3b/nvfp4too. - POLICY_
SOURCES - 2026-09-30: Where each derived setting comes from, printed in the report.
Functions§
- derive_
policy - 2026-09-30: The serving policy of a checkpoint-derived circuit (
POLICY_SOURCES).