pack_bf16_weight_to_nvfp4_t

spark_runtime::cutlass

Function pack_bf16_weight_to_nvfp4_t 

Source 
pub fn pack_bf16_weight_to_nvfp4_t(
    weight_bf16: u64,
    packed_t: u64,
    scale_t: u64,
    n: u32,
    k: u32,
    stream: u64,
) -> Result<()>
Expand description

Pack BF16 row-major weight [N,K] into the native CUTLASS NVFP4 layout: packed [N,K/2] (N-major, K-contiguous — NOT the Atlas transposed [K/2,N]) and E4M3 scales [K/16,N]. weight_scale_2 is assumed to be 1.0 by the caller when feeding this into the native CUTLASS wrapper.