pub fn lora_rotate_env() -> boolExpand description
ATLAS_LORA_ROTATE=1 (or true) ARMS runtime adapter rotation: it forces
eager decode (no CUDA-graph capture) so a set_active_lora re-point is
immediately live (eager-on-rotate — the graph would otherwise replay the
previously-captured slot pointers). A pool with >1 resident adapter arms
this automatically (see TransformerModel::lora_rotatable), so this env is
only needed to arm rotation on a SINGLE resident adapter (e.g. RDMA
slot-swap-in-place). Unset + a single startup adapter = today’s behaviour
exactly (graphs ON, slot-0 pointers baked).
See lora_eager_env on why this is not cached.