pub struct DrawSpec {
pub categories: Vec<String>,
pub category_pct: BTreeMap<String, f64>,
pub subset_floor: Option<usize>,
}Expand description
2026-09-26: Sampling configuration.
Fields§
§categories: Vec<String>2026-09-26: Categories to include. Empty means every single-turn
subset, including the uncategorised live_relevance.
category_pct: BTreeMap<String, f64>2026-09-26: Per-category percentage. A selected subset whose category has no entry is taken whole.
subset_floor: Option<usize>2026-09-26: A subset of at most this many rows is taken in full,
bypassing the percentage, so live_parallel (16 rows) is not cut to one
to three samples.
Implementations§
Source§impl DrawSpec
impl DrawSpec
Sourcepub fn golden() -> Self
pub fn golden() -> Self
2026-09-26: The golden MLPerf-edge draw: the three categories at
62/10/10 with a floor of 25. On reference_subset_totals this is 995.
Sourcepub fn full() -> Self
pub fn full() -> Self
2026-09-26: Every sample of the three scored categories, no sampling.
The same categories as golden: taking live_relevance too would move
overall_accuracy on a subset no category scores.
Sourcepub fn echolp() -> Self
pub fn echolp() -> Self
2026-09-26: The echolp draw: the three categories at 46/23/12 with a
floor of 25. On reference_subset_totals this is 1004. It weights live
more than twice as heavily as golden (23 % vs 10 %), so a score from one
draw is not comparable to a threshold from the other; each has its own
baseline.
Sourcepub fn mini() -> Self
pub fn mini() -> Self
2026-10-03: The mini draw for a model’s cheap correctness suite: the golden draw’s
three categories at about a fifth of its rates (12.5/2/2) with a floor of 5, so the
category mix stays close to golden. On reference_subset_totals this is
MINI_SAMPLES. Not comparable to golden or echolp; it carries its own floors.
Sourcepub fn includes(&self, subset: &str) -> bool
pub fn includes(&self, subset: &str) -> bool
2026-09-26: Whether this subset is in the selection.
Sourcepub fn take_count(&self, subset: &str, total: usize) -> usize
pub fn take_count(&self, subset: &str, total: usize) -> usize
2026-09-26: How many rows to keep from a subset holding total rows.
Trait Implementations§
impl StructuralPartialEq for DrawSpec
Auto Trait Implementations§
impl Freeze for DrawSpec
impl RefUnwindSafe for DrawSpec
impl Send for DrawSpec
impl Sync for DrawSpec
impl Unpin for DrawSpec
impl UnwindSafe for DrawSpec
Blanket Implementations§
§impl<T> ArchivePointee for T
impl<T> ArchivePointee for T
§type ArchivedMetadata = ()
type ArchivedMetadata = ()
§fn pointer_metadata(
_: &<T as ArchivePointee>::ArchivedMetadata,
) -> <T as Pointee>::Metadata
fn pointer_metadata( _: &<T as ArchivePointee>::ArchivedMetadata, ) -> <T as Pointee>::Metadata
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more