pub const REDUCE_ATTN_ENQ: usize = 15;
2026-09-25: Host time to enqueue the attention and MLP all-reduces, without a synchronise. REDUCE_ATTN and REDUCE_MLP then time only the synchronize that follows the enqueue.
REDUCE_ATTN
REDUCE_MLP
synchronize