NVFP4_GROUP_SIZE

Constant NVFP4_GROUP_SIZE 

Source
pub const NVFP4_GROUP_SIZE: usize = 16;
Expand description

Group size for per-group FP8 scales. Matches NVFP4_GROUP_SIZE in the per-quant attention kernels.