pub enum SsmRollbackMode {
Snapshot,
Replay,
}Expand description
SSM verify-rollback mode (--ssm-rollback-mode, EXPERIMENTAL scaffold).
Snapshot(the serve default, explicit in the CLI): every verify arm writes per-token h/conv state snapshots; a partial accept restores fromintermediates[num_accepted - 1]. This is the only mode whose device path is wired — its sizing and behavior are pinned byte-for-byte.Replay: keep ONLY the pre-verify checkpoint blob per verify slot and cache the verify window’s per-token GDN INPUTS (the deinterleaved qkvz row each conv1d consumes plus the gate/beta row — the tensors the WY verify kernels read) in a small ring; a partial accept re-runs the accepted tokens from the checkpoint through the existing sequential recurrent path. Device wiring (capture + replay) is NOT implemented: a serve in this mode boots — the reserve shows the capacity win — and every speculative verify entry refuses loudly (SsmStatePool::require_verify_rollback_supported).
Variants§
Trait Implementations§
Source§impl Clone for SsmRollbackMode
impl Clone for SsmRollbackMode
Source§fn clone(&self) -> SsmRollbackMode
fn clone(&self) -> SsmRollbackMode
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for SsmRollbackMode
impl Debug for SsmRollbackMode
Source§impl FromStr for SsmRollbackMode
impl FromStr for SsmRollbackMode
Source§impl PartialEq for SsmRollbackMode
impl PartialEq for SsmRollbackMode
impl Copy for SsmRollbackMode
impl Eq for SsmRollbackMode
impl StructuralPartialEq for SsmRollbackMode
Auto Trait Implementations§
impl Freeze for SsmRollbackMode
impl RefUnwindSafe for SsmRollbackMode
impl Send for SsmRollbackMode
impl Sync for SsmRollbackMode
impl Unpin for SsmRollbackMode
impl UnwindSafe for SsmRollbackMode
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.