fp8_gemv_rowscale_batch16_rt2

spark_model::layers::ops

Function fp8_gemv_rowscale_batch16_rt2 

Source 
pub fn fp8_gemv_rowscale_batch16_rt2(
    gpu: &dyn GpuBackend,
    kernel: KernelHandle,
    input: DevicePtr,
    weight: &Fp8DenseWeight,
    output: DevicePtr,
    m: u32,
    n: u32,
    k: u32,
    stream: u64,
) -> Result<()>
Expand description

MAX_M=16 sibling of fp8_gemv_rowscale_batch8_rt2 for the γ>8 DFlash propose window (flags 9..17). Same template, same launch geometry; added 2026-08-29 after STEP_TIMING measured propose 18.2ms (flag 8, rt2) vs 38.0ms (flag 9, tile fallback) — the whole γ>8 step tax. Kernel: fp8_gemv_rowscale_batch16_rt2 (module fp8_gemv_rt).