native_q2_mmq_enabled

Function native_q2_mmq_enabled 

Source
pub fn native_q2_mmq_enabled() -> bool
Expand description

2026-09-25: True only when METRALE_GGUF_NATIVE_Q2_MMQ is exactly 1. With it, and with the kernels resolved and group 128 on gate, up and down, the dense FFN prefill runs packed Q2 weights through q2_0_mmq_gemm instead of dequantizing them to BF16. Whether weights stay packed at all is METRALE_GGUF_NATIVE_Q2’s decision.