BenchmarkDescriptor

Struct BenchmarkDescriptor 

Source
pub struct BenchmarkDescriptor {
    pub id: &'static str,
    pub name: &'static str,
    pub summary: &'static str,
    pub detail: &'static str,
    pub duration_hint: &'static str,
    pub expected_secs: u64,
    pub updated: &'static str,
    pub needs_confirmation: bool,
    pub intended_for: Option<ModelExpectation>,
    pub threshold_params: &'static [(&'static str, &'static str)],
    pub sensitivity: Sensitivity,
    pub ctor: fn() -> Box<dyn DynBenchmark>,
}
Expand description

2026-09-26: Static identity of a benchmark, and how to construct one. The registry (registry::ALL), the TUI list pane and the run directories (ArtifactStore::runs_dir) all read it.

Fields§

§id: &'static str

2026-09-26: Stable and filename-safe ([a-z0-9-], checked by registry::tests::ids_are_unique_and_filename_safe). Names the run directory <home>/runs/<id>/.

§name: &'static str§summary: &'static str

2026-09-26: One line for the suite list.

§detail: &'static str

2026-09-26: A paragraph for the detail pane: what it measures and what it costs.

§duration_hint: &'static str

2026-09-26: Rough wall time at default parameters, for display, e.g. "~15 min".

§expected_secs: u64

2026-09-26: Expected wall time at default parameters, in seconds: the certification planner’s estimate when no completed run of this id has been measured (bench_certify::plan::units). Zero only on descriptors whose duration_hint starts with unrunnable (registry::tests::every_runnable_benchmark_declares_an_expected_duration).

§updated: &'static str

2026-09-26: When this benchmark’s measurement last changed (new thresholds, prompt set or scoring rule), as YYYY-MM-DD; not when its code was edited. It tells a reader whether two runs are comparable.

§needs_confirmation: bool

2026-09-26: True when starting has a side effect beyond load on the endpoint. The TUI (tui::bench_keys) and bench certify (--yes) require an explicit confirmation for these.

§intended_for: Option<ModelExpectation>

2026-09-26: The checkpoint families this benchmark is defined on, if any. The executor’s endpoint check (coherence::probe_for) warns on a mismatch and never refuses the run. None means the benchmark measures whatever it is pointed at.

§threshold_params: &'static [(&'static str, &'static str)]

2026-09-26: Parameters whose run-time value comes from the selected model variant’s committed bound, as (param key, metric key) pairs, for benchmarks that compute their own verdict against a knob that is also a BENCH.toml threshold (the agentic gate’s wall_budget_s against sum_wall_s). A gate run (bench_resolve::apply_threshold_params) and the TUI derive the value from the variant’s bound; an explicit --param wins.

§sensitivity: Sensitivity

2026-09-26: Whether this benchmark’s number is a speed number, and so corruptible by the state of the box that produced it. A required field of the descriptor, not a list in the hardware policy, so every new benchmark has to answer it. See crate::hardware::policy.

§ctor: fn() -> Box<dyn DynBenchmark>

Implementations§

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
§

impl<T> ArchivePointee for T

§

type ArchivedMetadata = ()

The archived version of the pointer metadata for this type.
§

fn pointer_metadata( _: &<T as ArchivePointee>::ArchivedMetadata, ) -> <T as Pointee>::Metadata

Converts some archived metadata to the pointer metadata for itself.
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

§

impl<T> Instrument for T

§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided [Span], returning an Instrumented wrapper. Read more
§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self>

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
§

impl<T> LayoutRaw for T

§

fn layout_raw(_: <T as Pointee>::Metadata) -> Result<Layout, LayoutError>

Returns the layout of the type.
§

impl<T, N1, N2> Niching<NichedOption<T, N1>> for N2
where T: SharedNiching<N1, N2>, N1: Niching<T>, N2: Niching<T>,

§

unsafe fn is_niched(niched: *const NichedOption<T, N1>) -> bool

Returns whether the given value has been niched. Read more
§

fn resolve_niched(out: Place<NichedOption<T, N1>>)

Writes data to out indicating that a T is niched.
§

impl<T> Pointable for T

§

const ALIGN: usize

The alignment of pointer.
§

type Init = T

The type for initializers.
§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
§

impl<T> Pointee for T

§

type Metadata = ()

The metadata type for pointers and references to this type.
Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
§

impl<T> WithSubscriber for T

§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a [WithDispatch] wrapper. Read more
§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a [WithDispatch] wrapper. Read more