lora_rotate_env

Function lora_rotate_env 

Source
pub fn lora_rotate_env() -> bool
Expand description

ATLAS_LORA_ROTATE=1 (or true) ARMS runtime adapter rotation: it forces eager decode (no CUDA-graph capture) so a set_active_lora re-point is immediately live (eager-on-rotate — the graph would otherwise replay the previously-captured slot pointers). A pool with >1 resident adapter arms this automatically (see TransformerModel::lora_rotatable), so this env is only needed to arm rotation on a SINGLE resident adapter (e.g. RDMA slot-swap-in-place). Unset + a single startup adapter = today’s behaviour exactly (graphs ON, slot-0 pointers baked). See lora_eager_env on why this is not cached.