lora_gemv_max_m

Function lora_gemv_max_m 

Source
pub fn lora_gemv_max_m() -> u32
Expand description

2026-09-25: Row count at or below which apply_lora_delta runs m single-row GEMV deltas instead of one GEMM: METRALE_LORA_GEMV_MAX_M, read once per process, default 48 when unset or unparsable. dense_gemm_tc tiles 16 rows (TC_TM in dense_gemm_tc.cu) and reads all of B whatever m is, so a small m pays full B traffic for a partly empty tile.