rms_norm_short_row_eligible

spark_model::layers::ops

Function rms_norm_short_row_eligible 

Source 
pub fn rms_norm_short_row_eligible(num_rows: u32, hidden_size: u32) -> bool
Expand description

Gate for rms_norm_warp_row: short even rows, many of them. Disable with ATLAS_RMS_NORM_WARP_ROW=0.