argmax_bf16_batch_lp

Function argmax_bf16_batch_lp 

Source
pub fn argmax_bf16_batch_lp(
    gpu: &dyn GpuBackend,
    kernel: KernelHandle,
    logits: DevicePtr,
    out: DevicePtr,
    out_logprob: DevicePtr,
    vocab_size: u32,
    n_rows: u32,
    row_stride: u32,
    stream: u64,
) -> Result<()>
Expand description

2026-09-25: argmax_bf16_batch that also writes each row’s top-1 log-probability, out_logprob[row] = log softmax(row)[argmax] in FP32, from an online softmax in the same pass over the row. D-Cut ranks verification depths by prefix sums of these values.