W8A8_LAUNCH_ROWS

Constant W8A8_LAUNCH_ROWS 

Source
pub const W8A8_LAUNCH_ROWS: usize = 128;
Expand description

2026-09-28: The most rows one GEMV launch serves (16 token tiles of 8).