REDUCE_ATTN_ENQ

Constant REDUCE_ATTN_ENQ 

Source
pub const REDUCE_ATTN_ENQ: usize = 15;
Expand description

2026-09-25: Host time to enqueue the attention and MLP all-reduces, without a synchronise. REDUCE_ATTN and REDUCE_MLP then time only the synchronize that follows the enqueue.