Expand description
2026-09-28: The live policy a plan is fused under: every setting the rules read, taken from the switch the legacy dispatch reads for it (the sources INSTANCES.toml cites), plus the switches no rule models, which the executor refuses when they are away from their default.
Owner: model-layers circuit executor. Invariants:
- Each setting is read from the one place legacy dispatch reads it; nothing here restates a default.
- A switch that changes legacy decode but that no rule reads is reported by
unmodelled_switches, never silently ignored. - The environment switches of the multi-sequence dispatch (
MULTI_SEQ_ENV_SWITCHES) are refused when present at all, whatever their value: over-refusal, never a misrun. Their readers parse them; this list only names them.
Constants§
- MULTI_
SEQ_ ENV_ SWITCHES - 2026-09-28: Environment switches of the multi-sequence decode and (2026-09-29) MTP verify dispatch whose defaults the rules’ row bands and arms encode, with the file that reads each.
Functions§
- kv_
dtype_ name - 2026-09-28: The spelling the rules use for a KV-cache dtype; an error for one the circuit has no rule for.
- live_
policy - 2026-09-28: The policy of this process:
kv_cache_dtypeandlm_head_dtypecome from the model being built, the rest from the process-wide switches. - unmodelled_
switches - 2026-09-28: Switches that change legacy decode which no rule reads, when they are set.