pub const W4A16_GEMV_MODULE: &str = "w4a16_gemv";Expand description
🔴 The DECODE weight kernel. w4a16_gemm is a tile GEMM: at M=1 it measured
9.7 GB/s on the routed experts — 26x off the 254 GB/s roofline and 45 % of the
whole decode step (2026-08-28 profile). Every routed-expert projection here is M=1.