nvfp4_grouped_down

Function nvfp4_grouped_down 

Source
pub fn nvfp4_grouped_down(
    a: u64,
    packed_ptrs: &[u64],
    sfb_ptrs: &[u64],
    scale2_vals: &[f32],
    c: u64,
    expert_offsets_host: &[i32],
    n: u32,
    k: u32,
    stream: u64,
) -> Result<()>
Expand description

2026-09-25: Grouped NVFP4 down projection, one kGrouped launch. a is the bf16 intermediate [M_total, K], already in expert order (no gather). packed_ptrs and sfb_ptrs hold one device pointer per expert to a [N,K/2] weight and its swizzled SFB scales; scale2_vals and expert_offsets_host are host arrays. Writes c [M_total, N].