router_dims

metrale_model_layers::lora

Function router_dims 

Source 
pub fn router_dims(cfg: &ModelConfig) -> (usize, usize)
Expand description

2026-09-25: (out_dim, in_dim) of the router (mlp.gate) projection. Its delta is added to the routing logits before top-k.