Expand description
2026-09-28: The circuit texts this binary was built from: INSTANCES.toml, the circuits, their
block libraries, the precision tables and each hardware’s FUSIONS.toml, embedded so a plan
matches the kernels compiled in. met circuit and the executor both read them here.
Owner: model-layers circuit executor. Invariants:
- One copy of every text: the CLI and the executor never embed their own.
- A lookup of a name the tables lack is an error, never a fallback to another entry.
Constants§
- BLOCKS
- 2026-09-28: Every block library a circuit can include.
- CHECKPOINTS
- 2026-09-28: Every checkpoint plan fixture an instance can name.
- CIRCUITS
- 2026-09-28: Every circuit an instance can name, by arch.
- FUSIONS
- 2026-09-28: FUSIONS.toml per hardware.
- INSTANCES
- 2026-09-28: kernels/circuits/INSTANCES.toml as built.
- PRECISION
- 2026-09-28: Every precision table an instance can name.
Functions§
- checkpoint_
shape - 2026-09-30: The shape a served checkpoint runs: its
config.jsonthrough the circuit’s config map (metrale_circuit::map_checkpoint, the one config-to-shape mapping), withvocabat the served vocabulary:ModelConfig::vocab_sizeafter the server caps it to the tokenizer (cap_vocab_size_to_tokenizer).served_shapethen checks it against INSTANCES.toml. - instance
- 2026-09-28: The instance serving
recipe. - instance_
for - 2026-09-28: The instance whose checkpoint and kernel target are these. Several recipes may
serve one checkpoint on one target; they must then agree on the circuit and the precision
source, the only parts the executor takes from an instance (the policy, and 2026-09-30 a
policy precision’s tier and kernel capabilities, are read live:
CircuitExec::build). - lookup
- 2026-09-28: The entry
keyoftable;whatnames the table in the error. - served_
shape - 2026-09-28: The shape a served model runs, checked against the instance’s stated shape. Every
dim must agree except
vocab, which the server caps to the tokenizer’s vocabulary (cap_vocab_size_to_tokenizer) and so may be smaller; the served value is the one the logits are sized by, so the plan is instantiated with it. - shape_
drift - 2026-09-28: Every way
from_configdisagrees with the instance’s stated shape. - sources
- 2026-09-28: The embedded texts
instanceis built from.