moe_w8a8_grouped_gemm_pm4

Function moe_w8a8_grouped_gemm_pm4 

Source
pub fn moe_w8a8_grouped_gemm_pm4(
    gpu: &dyn GpuBackend,
    kernel: KernelHandle,
    a_fp8: DevicePtr,
    a_scale: DevicePtr,
    weight_ptrs: DevicePtr,
    scale_ptrs: DevicePtr,
    output: DevicePtr,
    expert_offsets: DevicePtr,
    sorted_token_ids: DevicePtr,
    num_experts: u32,
    n: u32,
    k: u32,
    worklist: DevicePtr,
    total_tiles: DevicePtr,
    max_tiles: u32,
    stream: u64,
) -> Result<()>
Expand description

2026-09-25: moe_w8a8_grouped_gemm over the work-list from moe_build_tile_worklist (kernel moe_w8a8_grouped_gemm_pm4, same module), which must run first on the same stream. The grid follows the rule of moe_fp8_grouped_gemm: max_tiles clamped to 1..=16384.