pub fn shard_gdn_out_proj_row_parallel(
src: DevicePtr,
dims: &TpGdnDims,
gpu: &dyn GpuBackend,
) -> Result<(DevicePtr, usize, usize)>Expand description
2026-09-25: Shard the out_proj BF16 weight [h, full_value_dim] row-parallel on its
input dim (value_dim). Rank r keeps columns
[r*local_value_dim, (r+1)*local_value_dim) of every output row; the layer
sums the partial products with an all-reduce after the GEMM. Returns
(ptr, h, local_value_dim).