pub fn argmax_bf16_batch_lp(
gpu: &dyn GpuBackend,
kernel: KernelHandle,
logits: DevicePtr,
out: DevicePtr,
out_logprob: DevicePtr,
vocab_size: u32,
n_rows: u32,
row_stride: u32,
stream: u64,
) -> Result<()>Expand description
2026-09-25: argmax_bf16_batch that also writes each row’s top-1
log-probability, out_logprob[row] = log softmax(row)[argmax] in FP32,
from an online softmax in the same pass over the row. D-Cut ranks
verification depths by prefix sums of these values.