Struct CudaHost 

pub struct CudaHost {
    pub ctx: Arc<CudaContext>,
    pub stream: Arc<CudaStream>,
    /* private fields */
}

The CUDA context and stream — process-scoped, on purpose.

Creating and destroying a CUDA context is precisely what in-process model swapping exists to avoid: it is slow, it invalidates every handle in the process, and on GB10 UVM it is the operation with the worst failure modes. The context is derived from the device, not from the checkpoint, so one model’s context serves the next one unchanged.

Fields

ctx: Arc<CudaContext>

stream: Arc<CudaStream>

Implementations

impl CudaHost

pub fn ordinal(&self) -> usize

Trait Implementations

impl Send for CudaHost

impl Sync for CudaHost