pub struct MixedForwardResult {
pub decode_logits: DevicePtr,
pub prefill_logits: DevicePtr,
}Expand description
2026-09-25: Result of a mixed forward pass (decode rows plus one prefill chunk).
Fields§
§decode_logits: DevicePtr2026-09-25: Logits for the decode sequences, [N, vocab_size]; NULL when there are none.
prefill_logits: DevicePtr2026-09-25: Logits for the prefill sequence’s last token, [1, vocab_size]; NULL unless
the chunk was its last.
Auto Trait Implementations§
impl Freeze for MixedForwardResult
impl RefUnwindSafe for MixedForwardResult
impl Send for MixedForwardResult
impl Sync for MixedForwardResult
impl Unpin for MixedForwardResult
impl UnwindSafe for MixedForwardResult
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more