gated_rms_norm_strided

Function gated_rms_norm_strided 

Source
pub fn gated_rms_norm_strided(
    gpu: &dyn GpuBackend,
    kernel: KernelHandle,
    input: DevicePtr,
    gate: DevicePtr,
    weight: &DenseWeight,
    output: DevicePtr,
    heads_per_seq: u32,
    num_seqs: u32,
    hidden_size: u32,
    gate_stride: u32,
    eps: f32,
    group_size: u32,
    input_seq_stride: u32,
    gate_seq_stride: u32,
    output_seq_stride: u32,
    stream: u64,
) -> Result<()>
Expand description

2026-09-25: Gated RMS norm of every (head, sequence) row of a multi-sequence decode in one launch: heads_per_seq rows per sequence, num_seqs sequences. Sequence strides count elements of each buffer’s own type: input_seq_stride in f32, gate_seq_stride and output_seq_stride in BF16.

The kernel, gated_rms_norm_f32_input_strided in kernels/gb10/common/rms_norm.cu, has the per-row body of gated_rms_norm_f32_input; only the row’s base address differs.