MOE_ROW_BATCH_MAX_ROWS

Constant MOE_ROW_BATCH_MAX_ROWS 

Source
pub const MOE_ROW_BATCH_MAX_ROWS: usize = 8;
Expand description

2026-09-25: Widest compiled w4a16_gemv_sw_moe_batchm_mR tier: the METRALE_MOE_BATCHM_ENTRY(2..=8) instances in kernels/gb10/common/w4a16_gemv.cu, held at index R - 2 of Glm5NextMlpKernels::w4a16_gemv_sw_moe_batchm. forward_moe splits a wider row group into sub-groups no wider than this.