Trait LayerState 

pub trait LayerState: Send + Sync {
    // Required methods
    fn as_any(&self) -> &dyn Any;
    fn as_any_mut(&mut self) -> &mut dyn Any;
}

Per-layer persistent state tracked across decode steps.

Attention layers use EmptyLayerState (KV lives in PagedKvCache). SSM layers use SsmLayerState (recurrent h_state + conv_state). Custom layers can implement this trait for arbitrary state.

Required Methods

fn as_any(&self) -> &dyn Any

fn as_any_mut(&mut self) -> &mut dyn Any

Implementors

impl LayerState for Glm5NextDsaState

impl LayerState for AttnLayerState

impl LayerState for EmptyLayerState

impl LayerState for SsmLayerState