moe

metrale_model_arch::deepseek_v41_ref::moe

Function moe 

Source 
pub fn moe(
    x: &[f32],
    tokens: usize,
    w: &MoeWeights<'_>,
    c: &MoeCfg,
) -> (Vec<f32>, Vec<f32>, Vec<usize>)
Expand description

2026-09-25: The MoE forward on one rank. Returns (y[tokens, dim] bf16 values, routing weights, routing indices).