pub struct WeightPeerConfig {
pub rails: Vec<(String, u32)>,
pub max_blade_bytes: u64,
pub staged_dirs: Vec<PathBuf>,
pub allow_any_path: bool,
}Expand description
Peer configuration: the RDMA rails, the memory ceiling, and how the peer resolves a model request to a directory.
Fields§
§rails: Vec<(String, u32)>(device, gid_idx) per rail, in link order (rail 0 = the cabled
link). Mirrors expert_peer::RdmaConfig::rails.
max_blade_bytes: u64Ceiling on total registered (staged) RAM in bytes across ALL staged
models. 0 = unlimited. Each model is charged its shard bytes once,
at first stage (the per-connection MRs share the same warm pages).
staged_dirs: Vec<PathBuf>Model directories to pre-stage at startup. Also the allow-list when
allow_any_path is false: a client may only request a model whose
resolved path matches one of these (or its basename).
allow_any_path: boolWhen true, a client may request ANY filesystem path and the peer stages it on demand (convenient for a trusted LAN; off by default).
Trait Implementations§
Source§impl Clone for WeightPeerConfig
impl Clone for WeightPeerConfig
Source§fn clone(&self) -> WeightPeerConfig
fn clone(&self) -> WeightPeerConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for WeightPeerConfig
impl Debug for WeightPeerConfig
Auto Trait Implementations§
impl Freeze for WeightPeerConfig
impl RefUnwindSafe for WeightPeerConfig
impl Send for WeightPeerConfig
impl Sync for WeightPeerConfig
impl Unpin for WeightPeerConfig
impl UnwindSafe for WeightPeerConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more