Module sensitive

Module sensitive 

Source
Expand description

2026-09-26: The BFCL samples whose answer depended on what ran before them. Measured 2026-09-08: the golden n=995 draw run whole and the same draw run as four shards disagreed on exactly these sample_ids. The mechanism is cross-request SSM snapshot reuse, described in crate::gate::group. The driver warns on each of these it runs and reports the count as the known_partition_sensitive metric; membership does not change how a sample is scored.

Owner: bench, BFCL benchmark. Invariants: KNOWN_PARTITION_SENSITIVE is sorted and free of duplicates.

Constants§

KNOWN_PARTITION_SENSITIVE
2026-09-26: Sorted, because is_known binary-searches it.

Functions§

is_known