Struct KdaShardedSource 

pub struct KdaShardedSource<'a> { /* private fields */ }

A KdaTensorSource that yields this rank’s slice of every KDA tensor.

Wrap the full-checkpoint source in this and hand it to bind_kda_weights unchanged.

Implementations

impl<'a> KdaShardedSource<'a>

pub fn new(inner: &'a dyn KdaTensorSource, plan: &'a KdaTpPlan) -> Result<Self>

pub fn plan(&self) -> &KdaTpPlan

Trait Implementations

impl KdaTensorSource for KdaShardedSource<'_>

fn get(&self, name: &str) -> Option<RawTensor<'_>>

fn names(&self) -> Vec<String>

Every layer-relative name present, including non-attention ones.