Struct MtpProposerState 

pub struct MtpProposerState {
    pub block_table: Vec<u32>,
    pub seq_len: usize,
    pub last_num_drafted: usize,
    pub last_pair_key: Option<usize>,
}

Per-sequence MTP proposer state.

Fields

block_table: Vec<u32>

Block table for MTP’s own KV cache.

seq_len: usize

Current sequence length in MTP’s KV cache.

last_num_drafted: usize

Number of drafts produced in the last propose() call. Used by after_verify to know how many entries to trim.

last_pair_key: Option<usize>

Sequence-space pair key of the newest drafter row (a forward_one call with RoPE position p writes pair key p - 1). seq_len alone cannot locate the drafter in the sequence — without drafter prefill the row space is compacted (accepted pairs only) and drifts from the sequence position. None until the first row is written.

Trait Implementations

impl ProposerState for MtpProposerState

fn as_any(&self) -> &dyn Any

fn as_any_mut(&mut self) -> &mut dyn Any