pub struct Glm5NextExpertPtrTable {
pub packed_ptrs: DevicePtr,
pub scale_ptrs: DevicePtr,
pub scale2_vals: DevicePtr,
}Expand description
Device-side pointer tables for ONE projection across the full expert set.
Indexed by GLOBAL expert id, so the grouped kernel can go straight from the router’s
on-device ids to weights with no host round trip. Experts another EP rank owns carry a
null packed/scale pointer; the kernel writes nothing for those slots and the
caller’s pre-zeroed output row stands.
Fields§
§packed_ptrs: DevicePtr[num_experts] U64 device pointers to each expert’s packed NVFP4 weight.
scale_ptrs: DevicePtr[num_experts] U64 device pointers to each expert’s block scales.
scale2_vals: DevicePtr[num_experts] F32 per-expert weight_scale_2.
Trait Implementations§
Source§impl Clone for Glm5NextExpertPtrTable
impl Clone for Glm5NextExpertPtrTable
Source§fn clone(&self) -> Glm5NextExpertPtrTable
fn clone(&self) -> Glm5NextExpertPtrTable
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for Glm5NextExpertPtrTable
impl Debug for Glm5NextExpertPtrTable
impl Copy for Glm5NextExpertPtrTable
Auto Trait Implementations§
impl Freeze for Glm5NextExpertPtrTable
impl RefUnwindSafe for Glm5NextExpertPtrTable
impl Send for Glm5NextExpertPtrTable
impl Sync for Glm5NextExpertPtrTable
impl Unpin for Glm5NextExpertPtrTable
impl UnwindSafe for Glm5NextExpertPtrTable
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more