Expand description
File-backed KV cache spill manager.
Manages swap files for sequence-level KV cache + SSM state overflow. The serialization format is owned by the Model; this module handles file lifecycle and disk space enforcement.
Structsยง
- KvSpill
Manager - Manages swap file creation, opening, deletion, and space limits.