Struct ExpertWeight 

pub struct ExpertWeight {
    pub gate_proj: QuantizedWeight,
    pub up_proj: QuantizedWeight,
    pub down_proj: QuantizedWeight,
}

MoE expert weights (shared across all 512 experts per layer).

Fields

gate_proj: QuantizedWeight

up_proj: QuantizedWeight

down_proj: QuantizedWeight

Implementations

impl ExpertWeight

pub fn null() -> Self

Null expert (all pointers NULL). Used for remote experts under EP. Kernels detect NULL pointers and write zero output for these experts.

Trait Implementations

impl Clone for ExpertWeight

fn clone(&self) -> ExpertWeight

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ExpertWeight

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl From<ExpertWeight> for QuantExpertWeight

fn from(w: ExpertWeight) -> Self

Converts to this type from the input type.

impl Copy for ExpertWeight