Module device_cache

metrale_model_arch::kimi_k3

Module device_cache 

Source
Expand description

2026-09-25: DeviceHybridCache: device copies of every layer’s Kimi K3 mixer state, built from a host HybridCache.

Owner: model-arch, Kimi K3. Invariants: none beyond the types.

Structs§

DeviceHybridCache
DeviceLayerCache
2026-09-25: One layer’s device state: KDA state for a KDA layer, or MLA k/v buffers sized for cap tokens for an MLA layer.