rms_norm_gated

metrale_model_arch::glm5next_kda_ref

Function rms_norm_gated 

Source 
pub fn rms_norm_gated(
    x: &[f32],
    weight: &[f32],
    gate: &[f32],
    d: usize,
    eps: f32,
) -> Vec<f32>
Expand description

2026-09-25: Gated RMSNorm over the trailing d, FP32, with a sigmoid gate. eps is the caller’s rms_norm_eps.