MOE_ROUTER_RT_MIN_ROWS

metrale_model_layers::layers::ops

Constant MOE_ROUTER_RT_MIN_ROWS 

Source 
pub const MOE_ROUTER_RT_MIN_ROWS: u32 = 1024;
Expand description

2026-09-28: Fewest rows for which moe_router_gemm_rt beats dense_gemm_router on GB10 (measured: 0.82x at 300 rows, 2.5x at 1000, 3.0-3.5x at 4k-32k).