Module group

Module group 

Source
Expand description

2026-09-25: Group addressing for the high-speed-swap layer. A group is the K or V stripe of one (layer, block, kv_head): block_size × head_dim × elem_bytes bytes, padded to a multiple of fs_block_size.

Owner: metrale-storage high-speed swap. Invariants:

  • Within a layer, block b occupies block_bytes() contiguous bytes at b · block_bytes(): the K stripes of every kv_head, then the V stripes.
  • For keys inside the layout, group_id maps each (layer, block, kind, kv_head) to a distinct id in 0 .. num_layers · 2 · num_blocks · num_kv_heads, in the same order as file_offset.

Structs§

GroupId
GroupKey
GroupLayout

Enums§

KvKind