q12_batched_scratch_bytes_varlen

Function q12_batched_scratch_bytes_varlen 

Source
pub fn q12_batched_scratch_bytes_varlen(
    n: usize,
    total_tokens: usize,
    max_chunk_len: usize,
    top_k: usize,
    mrope: bool,
) -> usize
Expand description

2026-09-25: q12_batched_scratch_bytes for a ragged batch: total_tokens is the packed total and max_chunk_len sizes the per-stream metadata slots, so a varlen batch is not charged the longest stream’s length for every stream.