compressor

metrale_model_arch::deepseek_v41_ref::compress

Function compressor 

Source 
pub fn compressor(
    x: &[f32],
    seqlen: usize,
    start_pos: usize,
    ratio: usize,
    dim: usize,
    hd: usize,
    w: &CompressorWeights<'_>,
    st: &mut CompressorState,
    eps: f32,
) -> Option<Vec<f32>>
Expand description

2026-09-25: The pre-RoPE latent [groups][hd] (bf16 values), or None while a group is still filling (prefill shorter than ratio, or a decode step that does not complete a group).