Struct TpMoeDims 

pub struct TpMoeDims {
    pub tp_rank: usize,
    pub tp_size: usize,
    pub h: usize,
    pub full_inter: usize,
    pub local_inter: usize,
}

Pre-TP-shard dimensions for MoE expert projections. Unlike attention, main.rs does NOT divide moe_intermediate_size by tp_size, so full_inter == config.moe_intermediate_size. Local size is computed here for downstream callers.

Fields

tp_rank: usize

tp_size: usize

h: usize

full_inter: usize

Full MoE intermediate dim (NOT yet TP-divided).

local_inter: usize

Local (post-shard) MoE intermediate dim.

Implementations

impl TpMoeDims

pub fn from_config(config: &ModelConfig) -> Self

pub fn proj_shape(&self, name: &str) -> Option<(usize, usize, TpShardKind)>

(out_dim, in_dim, kind) for one of gate_proj / up_proj / down_proj. Gate/up are column-parallel on inter; down is row-parallel on inter (so [h, inter] rows truncate to [h, inter/tp]).

Trait Implementations

impl Clone for TpMoeDims

fn clone(&self) -> TpMoeDims

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TpMoeDims

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Copy for TpMoeDims