pub enum DecodeRows {
Tokens(Vec<u32>),
HostLogits {
elem_bytes: usize,
},
}Expand description
2026-09-25: The rows of a decode step after the readback.
Variants§
Tokens(Vec<u32>)
2026-09-25: The device argmax per row.
HostLogits
2026-09-25: The logits block was copied into the plan’s buffer; elem_bytes is
the element width the model writes (2 = BF16, 4 = FP32).
Trait Implementations§
Auto Trait Implementations§
impl Freeze for DecodeRows
impl RefUnwindSafe for DecodeRows
impl Send for DecodeRows
impl Sync for DecodeRows
impl Unpin for DecodeRows
impl UnwindSafe for DecodeRows
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more