kda_reference_layer

Function kda_reference_layer 

Source
pub fn kda_reference_layer(
    hidden: &[f32],
    q: &[f32],
    k: &[f32],
    v: &[f32],
    w: &KdaWeights<'_>,
    dims: KdaDims,
    lower_bound: f32,
    rms_eps: f32,
    state: &mut [f32],
) -> Vec<f32>
Expand description

2026-09-25: Reference for one KDA layer from post-conv q/k/v to the o_proj output. The short conv is not included; the golden’s inputs are post-conv.