Struct PrefillSlice 

pub struct PrefillSlice<'a> {
    pub prompt_tokens: &'a [u32],
    pub seq: &'a mut SequenceState,
    pub chunk_start: usize,
    pub chunk_len: usize,
    pub is_last_chunk: bool,
}

2026-09-25: One prefilling stream’s chunk. prefill_batch_chunk and mixed_forward_batch take a &mut [PrefillSlice<'_>] and run every stream’s chunk in one forward pass.

Fields

prompt_tokens: &'a [u32]

2026-09-25: The stream’s full prompt.

seq: &'a mut SequenceState

chunk_start: usize

2026-09-25: Offset into prompt_tokens where this chunk starts.

chunk_len: usize

is_last_chunk: bool

2026-09-25: Whether this is the stream’s final chunk, which produces its last-token logits.