Expand description
2026-09-26: The committed shape of one gate run, the baseline shapes it is judged against, and reading both.
Owner: bench gate (records). Invariants:
GateRecord::from_runnever builds a record with an emptygit_shaor from aRunningframe.
Structs§
- Bound
- 2026-09-26: One metric’s threshold:
minalone is a floor,maxalone a ceiling, both a range, and equal values an exact pin (scoring::compare). - Gate
Baseline - 2026-09-26: The thresholds a benchmark’s gate records must meet, assembled
by
super::benchfrom the measured entries in everykernels/<hw>/<model>/BENCH.toml. Keyed hardware, then model, andcheck_recordscores a record only against its own pair. The records themselves live under.benchmarks/<id>/. - Gate
Record - 2026-09-26: One run record, as committed under
.benchmarks/<id>/. - Hardware
Baseline - 2026-09-26: Every measured model on one box class, and which one to serve by default.
- Model
Baseline - 2026-09-26: One (hardware, model) pair’s thresholds, and the recipe that serves the model.
Functions§
- date_of
- 2026-09-26:
YYYY-MM-DD(UTC) from unix seconds. - merge_
serve_ overrides - 2026-09-26: Baseline pins first; the operator’s
--serve-overridewins on a clash. - now_
secs - 2026-09-26: Unix seconds now; 0 when the clock reads before the epoch.
- read_
baseline - 2026-09-26: The benchmark’s baseline, assembled from the BENCH.toml files.
- read_
record - 2026-09-26: Read and parse one record file.
- record_
path - 2026-09-26:
.benchmarks/<id>/YYYY-MM-DD-<sha>.jsonunderroot. - record_
path_ for - 2026-09-26: Where
recordis written:<date>-<sha><shard>.jsonfor its hardware’s default model, or when no baseline with hardware entries resolves; otherwise<date>-<sha>-<variant slug><shard>.json. A record whose hardware has no entry counts as default when it is any hardware’s default. - resolve_
perf_ env - 2026-09-26: Resolve
PERF_CONTROLSthroughlookup, substituting each default for an unset, empty or whitespace-only value. Takeslookupso tests need not set process environment variables. - variant_
slug - 2026-09-26: A file-name-safe slug of a checkpoint id: ASCII alphanumerics
and
.kept and lowercased, each run of other characters one-, edge-trimmed. Two ids can share a slug. - write_
record - 2026-09-26: Write one gate record and return its path. Creates the parent
directory; commits nothing. The path is
record_path_forunless that file holds a FAIL, in which case it is the re-run name. Errors when the re-run name holds a FAIL too, or when either file exists but is not a readable record.