Skip to main content

grouped_rms_norm

Function grouped_rms_norm 

Source
fn grouped_rms_norm(x: &[f32], w: &[bf16], group: usize, eps: f32) -> Vec<f32>
Expand description

RMSNorm applied independently to each group-wide slice, with a full width weight vector.