Struct MixedBatchResult 

pub struct MixedBatchResult {
    pub decode_logits: DevicePtr,
    pub prefill_logits: Vec<DevicePtr>,
}

2026-09-25: Result of a batched mixed forward pass: M decode rows plus N prefill chunks.

Fields

decode_logits: DevicePtr

2026-09-25: Logits for the decode rows, [M, vocab]; NULL when there are none.

prefill_logits: Vec<DevicePtr>

2026-09-25: One entry per prefill stream, in input order: [1, vocab] logits when that stream’s chunk was its last, NULL otherwise.