rms_norm_gated

Function rms_norm_gated 

Source
pub fn rms_norm_gated(
    x: &[f32],
    weight: &[f32],
    gate: &[f32],
    d: usize,
    eps: f32,
) -> Vec<f32>
Expand description

Gated RMSNorm over the trailing d, strict FP32, sigmoid gate.

eps is rms_norm_eps from the checkpoint config (1e-5 for GLM-5.3-Flash). vLLM never passes it and relies on FusedRMSNormGated’s default, which coincides here — do not rely on that.