GDN_DECODE_STRIDED_SMEM_CAP_MIN_BATCH

Constant GDN_DECODE_STRIDED_SMEM_CAP_MIN_BATCH 

Source
pub const GDN_DECODE_STRIDED_SMEM_CAP_MIN_BATCH: u32 = 16;
Expand description

2026-09-29: Smallest batch that takes the cap. Below it the cap costs more than the L2 it saves (32 value heads, B=4: 34.1 us uncapped, 43.7 us capped).