pub enum StateKind {
KdaRecurrent,
SparseKv,
}Expand description
Which cache a layer needs. KDA and DSA are mutually exclusive here, and admission needs BOTH kinds satisfied — a KDA slot is not interchangeable with KV blocks.
Variants§
KdaRecurrent
Recurrent [H/ep, 128, 128] fp32 state + a bf16 causal-conv window.
SparseKv
Paged KV blocks + the indexer’s own key state.
Trait Implementations§
impl Copy for StateKind
impl Eq for StateKind
impl StructuralPartialEq for StateKind
Auto Trait Implementations§
impl Freeze for StateKind
impl RefUnwindSafe for StateKind
impl Send for StateKind
impl Sync for StateKind
impl Unpin for StateKind
impl UnwindSafe for StateKind
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.