Module bench

Module bench 

Source
Expand description

2026-09-26: kernels/<hw>/<model>/BENCH.toml: a model’s benchmark entries and thresholds, beside its MODEL.toml, and baseline_for, which assembles one gate’s GateBaseline from every such file.

One file per model, one [[benchmarks]] entry per (quant, checkpoint, gate). Hardware and model come from the file’s path.

super::taxon::configs does not list BENCH.toml, so editing a threshold does not change any target’s closure hash.

Owner: bench gate. Invariants:

  • load_all refuses an entry whose status is neither measured nor unmeasured, an unmeasured entry with metrics, a measured entry without them, a port serve override, an incomplete hermetic pin set, an undeclared serve_env lever, and invalid noise.
  • baseline_for contains only measured entries, and exactly one default checkpoint per hardware.

Structs§

BenchEntry
2026-09-26: One [[benchmarks]] entry.

Functions§

baseline_for
2026-09-26: Assemble the baseline for one gate from every BENCH.toml in the tree.
load_all
2026-09-26: Every benchmark entry in the tree, validated, with the target each belongs to.