Module state

metrale_model_arch::kimi_k3

Module state 

Source
Expand description

2026-09-25: K3CpuFallbackState, one sequence’s Kimi K3 mixer state: the host LayerCache and the device copies the CUDA mixers use.

Snapshots and restores use the LayerCache byte format.

Owner: model-arch, Kimi K3. Invariants:

  • restore rejects a blob that does not parse, or whose mixer kind or geometry differs from the current state, before it changes anything.
  • release drops both device copies even when freeing one fails.

Structs§

K3CpuFallbackState
2026-09-25: Mixer state owned by one sequence; K3BoundLayer::release_state frees its device copies.