stage_overlay_raw

Function stage_overlay_raw 

Source
pub fn stage_overlay_raw(
    store: &WeightStore,
    overlay: &OverlayTensors,
    peft: &PeftAdapterConfig,
    h: usize,
    gpu: &dyn GpuBackend,
) -> Result<Option<OverlayRawSlot>>
Expand description

Stage 1 (loader): upload the classified overlay tensors of one adapter into owned device scratch. Ok(None) when the adapter ships no overlay tensors. embed_full/lmhead_full (modules_to_save) map onto the *_base slot.