Expand description
MoE (Mixture of Experts) FFN component.
Batched expert dispatch: top-K experts run in 2 fused kernel launches (gate+up, silu+down) instead of 10 × 5 individual launches. Expert indices and weights stay on device — zero D2H synchronization.
Structs§
- MoeLayer
- MoE feed-forward network component.