decode_w8a8_gemm

metrale_model_layers::layers::ops

Function decode_w8a8_gemm 

Source 
pub fn decode_w8a8_gemm(
    scratch: &DecodeW8a8Scratch,
    fp8w: &Fp8Weight,
    out: DevicePtr,
    plan: &DecodeW8a8Plan,
    stream: u64,
) -> Result<()>
Expand description

2026-09-25: out[m_pad, n] = act_fp8[m_pad, k] @ weight[n, k]ᵀ at row pitch plan.ldc, with both sets of scales applied. The activation must already be through decode_w8a8_quant_act.