BenchEntry

Struct BenchEntry 

Source
pub struct BenchEntry {
    pub quant: String,
    pub checkpoint: String,
    pub gate: String,
    pub recipe: Option<String>,
    pub label: String,
    pub default: bool,
    pub status: String,
    pub note: String,
    pub serve_overrides: BTreeMap<String, String>,
    pub param_overrides: BTreeMap<String, String>,
    pub serve_env: BTreeMap<String, String>,
    pub metrics: Option<BTreeMap<String, Bound>>,
}
Expand description

2026-09-26: One [[benchmarks]] entry.

Fields§

§quant: String

2026-09-26: The quant, used as the quant of the entry’s taxon::Target.

§checkpoint: String

2026-09-26: The served checkpoint; thresholds are keyed by it, not by the model directory.

§gate: String

2026-09-26: Benchmark id, e.g. bfcl-subset.

§recipe: Option<String>

2026-09-26: The recipe id <family>/<stem> that serves this entry, when there is one.

§label: String

2026-09-26: Human name for this variant in the TUI’s variant list; when empty the list shows the checkpoint id (tui::bench_variants).

§default: bool

2026-09-26: Whether this is the checkpoint the gate runs when none is named.

§status: String

2026-09-26: measured or unmeasured; load_all refuses anything else.

§note: String§serve_overrides: BTreeMap<String, String>

2026-09-26: Recipe keys self-start applies on every --pull-request-gate run, as strings matching --serve-override KEY=VALUE (e.g. ssm_cache_slots = "256" on the qwen3.6-35b-a3b bfcl-subset-echolp entry). Empty and omitted is the normal case. check_record requires the record’s serve overrides to equal this map exactly. port is refused: self-start binds a free port itself.

§param_overrides: BTreeMap<String, String>

2026-09-26: Benchmark parameter pins the gate applies on every --pull-request-gate run, for thresholds measured with non-default parameters. Empty and omitted is the normal case.

Values are strings parsed by each parameter’s own ParamKind::parse, like a typed --param KEY=VALUE, and an explicit --param wins (bench_resolve::apply_param_overrides). A key naming a threshold_params-coupled parameter, or no parameter at all, is refused there. check_record requires each pin on the record’s params, compared ignoring spaces around commas.

§serve_env: BTreeMap<String, String>

2026-09-26: METRALE_* serve levers the gate pins for this entry, applied to the serve on top of the recipe’s own env: block, for levers that are not recipe keys (e.g. METRALE_FP8_ROWWISE on the qwen3.8-27b concurrency-sweep entry). Empty and omitted is the normal case. Validated at parse by serve_env::declared; disclosed on the record as GateRecord::serve_env, never demanded by check_record.

§metrics: Option<BTreeMap<String, Bound>>

2026-09-26: Thresholds. Absent exactly when status is unmeasured.

Trait Implementations§

Source§

impl Clone for BenchEntry

Source§

fn clone(&self) -> BenchEntry

Returns a duplicate of the value. Read more
1.0.0 · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for BenchEntry

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl<'de> Deserialize<'de> for BenchEntry

Source§

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>
where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer. Read more
Source§

impl Serialize for BenchEntry

Source§

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>
where __S: Serializer,

Serialize this value into the given Serde serializer. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
§

impl<T> ArchivePointee for T

§

type ArchivedMetadata = ()

The archived version of the pointer metadata for this type.
§

fn pointer_metadata( _: &<T as ArchivePointee>::ArchivedMetadata, ) -> <T as Pointee>::Metadata

Converts some archived metadata to the pointer metadata for itself.
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

§

impl<T> Instrument for T

§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided [Span], returning an Instrumented wrapper. Read more
§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self>

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
§

impl<T> LayoutRaw for T

§

fn layout_raw(_: <T as Pointee>::Metadata) -> Result<Layout, LayoutError>

Returns the layout of the type.
§

impl<T, N1, N2> Niching<NichedOption<T, N1>> for N2
where T: SharedNiching<N1, N2>, N1: Niching<T>, N2: Niching<T>,

§

unsafe fn is_niched(niched: *const NichedOption<T, N1>) -> bool

Returns whether the given value has been niched. Read more
§

fn resolve_niched(out: Place<NichedOption<T, N1>>)

Writes data to out indicating that a T is niched.
§

impl<T> Pointable for T

§

const ALIGN: usize

The alignment of pointer.
§

type Init = T

The type for initializers.
§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
§

impl<T> Pointee for T

§

type Metadata = ()

The metadata type for pointers and references to this type.
Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
§

impl<T> WithSubscriber for T

§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a [WithDispatch] wrapper. Read more
§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a [WithDispatch] wrapper. Read more
Source§

impl<T> DeserializeOwned for T
where T: for<'de> Deserialize<'de>,