Module attention_ref

spark_storage

Module attention_ref 

Source

Structs§

AttnState

Functions§

finalize_ref
step_tile_ref
One tile update. Mirrors the CUDA kernel’s per-token online-softmax recurrence exactly (same accumulation order, fp32 throughout).