moe_w8a8_gateup_silu_e4m3

Function moe_w8a8_gateup_silu_e4m3 

Source
pub fn moe_w8a8_gateup_silu_e4m3(
    gpu: &dyn GpuBackend,
    kernel: KernelHandle,
    a_fp8: DevicePtr,
    a_scale: DevicePtr,
    gate: (DevicePtr, DevicePtr),
    up: (DevicePtr, DevicePtr),
    out_fp8: DevicePtr,
    out_scale: DevicePtr,
    expert_offsets: DevicePtr,
    sorted_token_ids: DevicePtr,
    n: u32,
    k: u32,
    worklist: DevicePtr,
    total_tiles: DevicePtr,
    grid_ctas: u32,
    stream: u64,
) -> Result<()>
Expand description

2026-09-28: moe_w8a8_gateup_silu_e4m3_w1 / _w2: the gate and up grouped GEMMs of one work-list item (the _gu shape, MOE_E4M3_GU) followed by SiLU(gate) * up quantized to E4M3 per 128-column group, bit-identical to the two _gu launches plus silu_mul_quant_fp8. Writes out_fp8 [total_expanded, n] and out_scale [total_expanded, n / 128]. The work-list is built with MOE_E4M3_GU’s shape.