kernel_caps

Function kernel_caps 

Source
pub fn kernel_caps() -> KernelCaps
Expand description

2026-09-28: Which decode families the policy may rely on. On: the dense per-channel W8A8 family (ops::w8a8_decode). 2026-09-29: On as well, validated on Qwen3.6-35B-A3B-FP8 by the full BFCL draw and agentic-webserver (declared against nvfp4, one binary, dgx3): the MoE expert W8A8 family (moe/fp8_grouped_tc_w8a8.rs). The block-scaled attention/GDN W8A8 adoption (qwen35/load_layers/w8a8_adopt.rs) is off again (2026-09-29, see below). Also on: the batched FP8 lm_head (model/lm_head_fp8_rows.rs, one weight pass per 128 rows at every row count), so declared takes a checkpoint’s declared FP8 head. Each W8A8 family still checks at run time that its kernels resolved and the shapes fit.