Struct ProjBytes 

pub struct ProjBytes {
    pub packed_bytes: u64,
    pub scale_bytes: u64,
}

Byte geometry of one NVFP4 projection sub-buffer inside an expert record.

NVFP4 (W4A4, group_size 16) stores each projection as two device buffers:

• packed — E2M1 nibbles, 2 values/byte, [K/2, N] in prefill-resident (transposed) layout, so packed_bytes = N * K / 2.
• scale — per-group FP8-E4M3 block scales, [K/16, N], so scale_bytes = N * K / group_size.

The two per-projection scalars (weight_scale_2, input_scale) are carried in the record header, which is why they are absent here.

Fields

packed_bytes: u64

scale_bytes: u64

Implementations

impl ProjBytes

pub fn nvfp4(n: u64, k: u64, group_size: u64) -> Self

n = output rows, k = contraction dim, group_size = NVFP4 block.

Trait Implementations

impl Clone for ProjBytes

fn clone(&self) -> ProjBytes

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ProjBytes

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for ProjBytes

fn eq(&self, other: &ProjBytes) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for ProjBytes

impl Eq for ProjBytes

impl StructuralPartialEq for ProjBytes