Module scoring

Module scoring 

Source
Expand description

2026-09-26: Scoring one record against one baseline, the pure half of the gate check: compare judges one metric against one bound, and check_record resolves the record’s own (hardware, checkpoint) pair and scores that entry’s pins and bounds.

Owner: bench gate (verdict). Invariants:

  • Nothing here reads the filesystem, git or the environment.
  • check_record returns None only when the entry declares at least one bound and every pin and bound is met.

Enums§

Comparison
2026-09-26: One metric’s comparison, or why it cannot be judged.

Functions§

check_record
2026-09-26: Check one record against its baseline. None means every pin and bound passed; Some carries the failures. A record whose (hardware, model) pair has no baseline entry fails.
compare
2026-09-26: Compare one recorded metric against its bound, widened by noise (0 when absent) on the failing side. No bound at all is Skip.