Struct EpRoutingTable 

pub struct EpRoutingTable {
    pub local_token_indices: Vec<u32>,
    pub local_expert_ids: Vec<u32>,
    pub local_weights: Vec<f32>,
    pub remote_token_indices: Vec<u32>,
    pub remote_expert_ids: Vec<u32>,
    pub remote_weights: Vec<f32>,
}

Routing table for EP token dispatch.

Partitions top-K expert assignments into local (this rank owns the expert) and remote (partner rank owns the expert) buckets. Each entry is a (token_index, expert_id, weight) triple.

Fields

local_token_indices: Vec<u32>

Token indices routed to this rank’s experts.

local_expert_ids: Vec<u32>

Expert IDs for local tokens (absolute, not rank-relative).

local_weights: Vec<f32>

Routing weights for local tokens.

remote_token_indices: Vec<u32>

Token indices routed to the remote rank’s experts.

remote_expert_ids: Vec<u32>

Expert IDs for remote tokens (absolute, not rank-relative).

remote_weights: Vec<f32>

Routing weights for remote tokens.

Implementations

impl EpRoutingTable

pub fn local_count(&self) -> usize

Number of (token, expert) pairs handled locally.

pub fn remote_count(&self) -> usize

Number of (token, expert) pairs dispatched to remote rank.

pub fn total_count(&self) -> usize

Total number of (token, expert) pairs (should equal num_tokens * top_k).

Trait Implementations

impl Debug for EpRoutingTable

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.