pub fn batched_embed(
gpu: &dyn GpuBackend,
kernel: KernelHandle,
token_ids_dev: DevicePtr,
embed_table: DevicePtr,
output: DevicePtr,
num_tokens: u32,
hidden_size: u32,
stream: u64,
) -> Result<()>Expand description
2026-09-25: Gather the BF16 embedding rows of num_tokens token ids
(token_ids_dev, device [num_tokens] u32) into output, one block per
token.