Enum Readback 

pub enum Readback<'a> {
    Argmax,
    ArgmaxMasked {
        masks: Vec<RowMask>,
    },
    HostLogits {
        into: &'a mut Vec<u8>,
    },
}

2026-09-25: How the logits of a decode step come back to the host.

Variants

Argmax

2026-09-25: One argmax id per row, computed on the device.

ArgmaxMasked

2026-09-25: The device argmax with the per-row two-id mask applied exactly as the host re-pick would (see argmax_feed.cu); the ids also land in the device feed cells for a following fed step.

Fields

masks: Vec<RowMask>

HostLogits

2026-09-25: The whole logits block, copied into into (resized by the router to rows * vocab * elem_bytes; the core samples over it).

Fields

into: &'a mut Vec<u8>

Trait Implementations

impl Debug for Readback<'_>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.