moe_w8a8_grouped_gemm_e4m3

Function moe_w8a8_grouped_gemm_e4m3 

Source
pub fn moe_w8a8_grouped_gemm_e4m3(
    gpu: &dyn GpuBackend,
    kernel: KernelHandle,
    tile: MoeE4m3Tile,
    a_fp8: DevicePtr,
    a_scale: DevicePtr,
    weight_ptrs: DevicePtr,
    scale_ptrs: DevicePtr,
    output: DevicePtr,
    expert_offsets: DevicePtr,
    sorted_token_ids: DevicePtr,
    n: u32,
    k: u32,
    worklist: DevicePtr,
    total_tiles: DevicePtr,
    grid_ctas: u32,
    stream: u64,
) -> Result<()>
Expand description

2026-09-27: moe_w8a8_grouped_gemm_pm4 on the native e4m3 tensor-core MMA (the _gu or _dn entry, described by tile): same operands and output, bit-identical, over a work-list that moe_build_tile_worklist built on the same stream with tile.m_tile and n / tile.n_tile. grid_ctas (clamped to 1..=16384) CTAs stride over the items.