pub fn required_model_recv_bytes(
tokens: usize,
hidden: usize,
vocab: usize,
) -> Result<usize>Expand description
2026-09-26: Receive-buffer bytes for tokens rows of BF16 activations or
logits: tokens × max(hidden, vocab) × 2. Serve passes max_batch_tokens,
hidden_size and vocab_size.
§Errors
When the product overflows usize.