Skip to main content

rms_norm_shift

Function rms_norm_shift 

Source
fn rms_norm_shift(x: &[f32], w: &[bf16], eps: f32) -> Vec<f32>
Expand description

RMSNorm with the raw HF weight convention: x * inv * (1 + w).