Expand description
Communication backend abstraction (SBIO IORouter for collective ops).
All distributed communication flows through CommBackend. Business
logic never calls NCCL or MPI directly.
SingleGpuBackend— all ops are no-ops (single GPU).NcclBackend— real multi-GPU via NCCL (expert parallelism; available with thencclfeature).
Re-exports§
pub use nccl_backend::NcclBackend;
Modules§
- nccl
- Raw NCCL FFI bindings (minimal surface for EP all-reduce + broadcast).
- nccl_
backend - NCCL-based communication backend for expert parallelism.
Structs§
- Single
GpuBackend - Single-GPU backend: all collective ops are no-ops.
Traits§
- Comm
Backend - Communication backend trait for distributed operations.