pub fn rms_norm(
gpu: &dyn GpuBackend,
kernel: KernelHandle,
input: DevicePtr,
weight: &DenseWeight,
output: DevicePtr,
num_tokens: u32,
hidden_size: u32,
eps: f32,
stream: u64,
) -> Result<()>Expand description
2026-09-25: RMS norm of num_tokens packed rows of hidden_size, one block
per row. How weight scales the result is the kernel’s: rms_norm in
kernels/gb10/common/rms_norm.cu multiplies by 1 + weight, and the
rms_norm_vanilla kernels by weight.