Struct Nvfp4Proj 

pub struct Nvfp4Proj {
    pub packed: DevicePtr,
    pub scale: DevicePtr,
    pub scale_2: f32,
}

One NVFP4 projection as ModelOpt stores it: packed e2m1 pairs, per-block e4m3 scales, and one global f32 scale.

🪤 The three travel together and are meaningless apart. weight_scale_2 is a scalar read off the device at load and passed by value — w4a16_gemm takes it as arg_f32, not as a pointer, so uploading it and passing the address silently reinterprets a pointer as a float.

Fields

packed: DevicePtr

[out, in/2] U8 — two e2m1 codes per byte.

scale: DevicePtr

[out, in/16] F8_E4M3 block scales.

scale_2: f32

The single global F32 scale.

Trait Implementations

impl Clone for Nvfp4Proj

fn clone(&self) -> Nvfp4Proj

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Nvfp4Proj

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Copy for Nvfp4Proj