lora_no_ffn

spark_model::layers::ops::lora_delta

Function lora_no_ffn 

Source 
pub fn lora_no_ffn() -> bool
Expand description

ATLAS_LORA_NO_FFN=1 — skip the dense-FFN and GDN-out_proj deltas, keep the attention ones.

The companion to ATLAS_LORA_NO_APPLY: that one answers “deltas or residency”, this one answers “which deltas”. Measurement only; output is wrong while set.