pub struct BenchEntry {
pub quant: String,
pub checkpoint: String,
pub gate: String,
pub recipe: Option<String>,
pub label: String,
pub default: bool,
pub status: String,
pub note: String,
pub serve_overrides: BTreeMap<String, String>,
pub param_overrides: BTreeMap<String, String>,
pub serve_env: BTreeMap<String, String>,
pub metrics: Option<BTreeMap<String, Bound>>,
}Expand description
2026-09-26: One [[benchmarks]] entry.
Fields§
§quant: String2026-09-26: The quant, used as the quant of the entry’s
taxon::Target.
checkpoint: String2026-09-26: The served checkpoint; thresholds are keyed by it, not by the model directory.
gate: String2026-09-26: Benchmark id, e.g. bfcl-subset.
recipe: Option<String>2026-09-26: The recipe id <family>/<stem> that serves this entry,
when there is one.
label: String2026-09-26: Human name for this variant in the TUI’s variant list;
when empty the list shows the checkpoint id (tui::bench_variants).
default: bool2026-09-26: Whether this is the checkpoint the gate runs when none is named.
status: String2026-09-26: measured or unmeasured; load_all refuses anything
else.
note: String§serve_overrides: BTreeMap<String, String>2026-09-26: Recipe keys self-start applies on every
--pull-request-gate run, as strings matching
--serve-override KEY=VALUE (e.g. ssm_cache_slots = "256" on the
qwen3.6-35b-a3b bfcl-subset-echolp entry). Empty and omitted is the
normal case.
check_record requires the record’s serve overrides to equal this map
exactly. port is refused: self-start binds a free port itself.
param_overrides: BTreeMap<String, String>2026-09-26: Benchmark parameter pins the gate applies on every
--pull-request-gate run, for thresholds measured with non-default
parameters. Empty and omitted is the normal case.
Values are strings parsed by each parameter’s own ParamKind::parse,
like a typed --param KEY=VALUE, and an explicit --param wins
(bench_resolve::apply_param_overrides). A key naming a
threshold_params-coupled parameter, or no parameter at all, is
refused there. check_record requires each pin on the record’s
params, compared ignoring spaces around commas.
serve_env: BTreeMap<String, String>2026-09-26: METRALE_* serve levers the gate pins for this entry,
applied to the serve on top of the recipe’s own env: block, for
levers that are not recipe keys (e.g. METRALE_FP8_ROWWISE on the
qwen3.8-27b concurrency-sweep entry). Empty and omitted is the normal
case. Validated at parse by serve_env::declared; disclosed on the
record as GateRecord::serve_env, never demanded by check_record.
metrics: Option<BTreeMap<String, Bound>>2026-09-26: Thresholds. Absent exactly when status is unmeasured.
Trait Implementations§
Source§impl Clone for BenchEntry
impl Clone for BenchEntry
Source§fn clone(&self) -> BenchEntry
fn clone(&self) -> BenchEntry
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read moreSource§impl Debug for BenchEntry
impl Debug for BenchEntry
Source§impl<'de> Deserialize<'de> for BenchEntry
impl<'de> Deserialize<'de> for BenchEntry
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Auto Trait Implementations§
impl Freeze for BenchEntry
impl RefUnwindSafe for BenchEntry
impl Send for BenchEntry
impl Sync for BenchEntry
impl Unpin for BenchEntry
impl UnwindSafe for BenchEntry
Blanket Implementations§
§impl<T> ArchivePointee for T
impl<T> ArchivePointee for T
§type ArchivedMetadata = ()
type ArchivedMetadata = ()
§fn pointer_metadata(
_: &<T as ArchivePointee>::ArchivedMetadata,
) -> <T as Pointee>::Metadata
fn pointer_metadata( _: &<T as ArchivePointee>::ArchivedMetadata, ) -> <T as Pointee>::Metadata
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more