Enum ExpertProj 

pub enum ExpertProj {
    Gate,
    Up,
    Down,
}

Which routed-expert projection a delta targets. Ordered so BTreeMap<(u16, ExpertProj), _> has a stable, testable key order.

Variants

Gate

Up

Down

Implementations

impl ExpertProj

pub fn peft_name(&self) -> &'static str

PEFT suffix (the leaf .-segment of the on-disk tensor name).

pub fn dims(&self, cfg: &ModelConfig, layer: usize) -> (usize, usize)

(out_dim, in_dim) of the base routed-expert projection on layer.

Uses the PER-LAYER routed intermediate (ModelConfig::moe_intermediate_size_for, e.g. 512 on Holo-3.1-35B-A3B) — NEVER the dense intermediate_size (5120), which belongs to the standalone SwiGLU FFN. gate/up map hidden→ inter, down maps inter→hidden.

Trait Implementations

impl Clone for ExpertProj

fn clone(&self) -> ExpertProj

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ExpertProj

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Ord for ExpertProj

fn cmp(&self, other: &ExpertProj) -> Ordering

This method returns an Ordering between self and other.

fn max(self, other: Self) -> Self

where Self: Sized,

Compares and returns the maximum of two values.

fn min(self, other: Self) -> Self

where Self: Sized,

Compares and returns the minimum of two values.

fn clamp(self, min: Self, max: Self) -> Self

where Self: Sized,

Restrict a value to a certain interval.

impl PartialEq for ExpertProj

fn eq(&self, other: &ExpertProj) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl PartialOrd for ExpertProj

fn partial_cmp(&self, other: &ExpertProj) -> Option<Ordering>

This method returns an ordering between self and other values if one exists.

fn lt(&self, other: &Rhs) -> bool

Tests less than (for self and other) and is used by the < operator.

fn le(&self, other: &Rhs) -> bool

Tests less than or equal to (for self and other) and is used by the <= operator.

fn gt(&self, other: &Rhs) -> bool

Tests greater than (for self and other) and is used by the > operator.

fn ge(&self, other: &Rhs) -> bool

Tests greater than or equal to (for self and other) and is used by the >= operator.

impl Copy for ExpertProj

impl Eq for ExpertProj

impl StructuralPartialEq for ExpertProj