Module policy

Module policy 

Source
Expand description

2026-09-28: The live policy a plan is fused under: every setting the rules read, taken from the switch the legacy dispatch reads for it (the sources INSTANCES.toml cites), plus the switches no rule models, which the executor refuses when they are away from their default.

Owner: model-layers circuit executor. Invariants:

  • Each setting is read from the one place legacy dispatch reads it; nothing here restates a default.
  • A switch that changes legacy decode but that no rule reads is reported by unmodelled_switches, never silently ignored.
  • The environment switches of the multi-sequence dispatch (MULTI_SEQ_ENV_SWITCHES) are refused when present at all, whatever their value: over-refusal, never a misrun. Their readers parse them; this list only names them.

Constants§

MULTI_SEQ_ENV_SWITCHES
2026-09-28: Environment switches of the multi-sequence decode and (2026-09-29) MTP verify dispatch whose defaults the rules’ row bands and arms encode, with the file that reads each.

Functions§

kv_dtype_name
2026-09-28: The spelling the rules use for a KV-cache dtype; an error for one the circuit has no rule for.
live_policy
2026-09-28: The policy of this process: kv_cache_dtype and lm_head_dtype come from the model being built, the rest from the process-wide switches.
unmodelled_switches
2026-09-28: Switches that change legacy decode which no rule reads, when they are set.