fp8_gemm_act_weight_t_rowwise

Function fp8_gemm_act_weight_t_rowwise 

Source
pub fn fp8_gemm_act_weight_t_rowwise(
    act_fp8: u64,
    act_scale: u64,
    weight_fp8: u64,
    weight_scale: u64,
    out: u64,
    m: u32,
    n: u32,
    k: u32,
    stream: u64,
) -> Result<()>
Expand description

2026-09-25: FP8 E4M3 out[M,N] = act[M,K] @ weight[N,K]ᵀ, BF16 output, with FP32 OUTER_VEC scales on both operands: weight_scale[N] per weight row (cuBLASLt’s A) and act_scale[M] per token (B).