Struct DeepseekV4MtpProposerState 

pub struct DeepseekV4MtpProposerState {
    pub block_table: Vec<u32>,
    pub seq_len: usize,
    pub last_num_drafted: usize,
    pub body_state: Box<dyn LayerState>,
}

Per-sequence state for the DeepSeek-V4 MTP proposer.

Fields

block_table: Vec<u32>

Block table for the MTP module’s OWN KV cache.

seq_len: usize

Current sequence length in the MTP KV cache.

last_num_drafted: usize

Drafts produced by the last propose() (for after_verify trimming).

body_state: Box<dyn LayerState>

Per-layer state for the reused V4 body. MLA attention layers use EmptyLayerState, but we allocate it via body.alloc_state so any future stateful body type is handled correctly (no hard-coded assumption).

Trait Implementations

impl ProposerState for DeepseekV4MtpProposerState

fn as_any(&self) -> &dyn Any

fn as_any_mut(&mut self) -> &mut dyn Any