shard_dense_weight

Function shard_dense_weight 

Source
pub fn shard_dense_weight(
    src: &DenseWeight,
    out_dim: usize,
    in_dim: usize,
    kind: TpShardKind,
    tp_rank: usize,
    tp_size: usize,
    gpu: &dyn GpuBackend,
) -> Result<(DenseWeight, usize, usize)>
Expand description

2026-09-25: shard_dense_bf16 on a DenseWeight, with the same ownership rule: a new buffer only when a shard happened, and then the caller frees the source.