kv_blocks_for

Function kv_blocks_for 

Source
pub fn kv_blocks_for(
    sequences: u64,
    tokens: u64,
    block_size: u64,
) -> Option<u64>
Expand description

2026-10-02: KV blocks sequences sequences of tokens tokens each hold, as the scheduler’s admission reserves them (tokens / block_size + 1 per sequence: the block the next token writes into is reserved with the prompt), plus the pool’s one dummy block. None for a zero block size or on overflow.