fp8_gemm_act_weight_t_blkscaled

Function fp8_gemm_act_weight_t_blkscaled 

Source
pub fn fp8_gemm_act_weight_t_blkscaled(
    act_fp8: u64,
    act_scale: u64,
    weight_fp8: u64,
    weight_block_scale: u64,
    out: u64,
    m: u32,
    n: u32,
    k: u32,
    stream: u64,
) -> Result<()>
Expand description

Native FP8 (E4M3) out[M,N] = act[M,K] @ weight[N,K]ᵀ → BF16, with the weight per-128×128-block FP32-scaled (matches Atlas’s Fp8Weight.row_scale layout exactly) and the activation cast at unit scale (post-RMSNorm acts sit in fp8’s range). ~1.8× the bf16 path (152 vs 85 TFLOPS on GB10).