Expand description
2026-09-26: kernels/<hw>/<model>/BENCH.toml: a model’s benchmark entries
and thresholds, beside its MODEL.toml, and baseline_for, which
assembles one gate’s GateBaseline from every such file.
One file per model, one [[benchmarks]] entry per (quant, checkpoint,
gate). Hardware and model come from the file’s path.
super::taxon::configs does not list BENCH.toml, so editing a
threshold does not change any target’s closure hash.
Owner: bench gate. Invariants:
load_allrefuses an entry whosestatusis neithermeasurednorunmeasured, anunmeasuredentry with metrics, ameasuredentry without them, aportserve override, an incomplete hermetic pin set, an undeclaredserve_envlever, and invalidnoise.baseline_forcontains onlymeasuredentries, and exactly one default checkpoint per hardware.
Structs§
- Bench
Entry - 2026-09-26: One
[[benchmarks]]entry.
Functions§
- baseline_
for - 2026-09-26: Assemble the baseline for one gate from every
BENCH.tomlin the tree. - load_
all - 2026-09-26: Every benchmark entry in the tree, validated, with the target each belongs to.