vision_tokens

Function vision_tokens 

Source
pub fn vision_tokens(prompt_tokens: usize, overhead: usize) -> Result<usize>
Expand description

2026-09-26: Vision tokens in a request: prompt_tokens minus the template overhead, or an error when overhead is larger.

The driver measures overhead once per run, from a calibration request whose vision-token count is known, because it depends on the checkpoint’s chat template.