served_shape

Function served_shape 

Source
pub fn served_shape(stated: &ArchShape, served: &ArchShape) -> Result<ArchShape>
Expand description

2026-09-28: The shape a served model runs, checked against the instance’s stated shape. Every dim must agree except vocab, which the server caps to the tokenizer’s vocabulary (cap_vocab_size_to_tokenizer) and so may be smaller; the served value is the one the logits are sized by, so the plan is instantiated with it.