pub enum LoraTarget {
Attn(LoraModule),
Router,
Expert {
n: u16,
proj: ExpertProj,
},
}Expand description
The decoded target of one PEFT LoRA tensor. Attn keeps the existing dense
LoraModule path byte-identical; Router / Expert are the Feature-1
additions routed into per-layer ExpertLoraLayer / router storage.
Variants§
Attn(LoraModule)
One of the 7 dense projections (q/k/v/o/gate/up/down_proj).
Router
The MoE router mlp.gate ([num_experts, hidden]).
Expert
One routed expert’s projection (mlp.experts.{n}.{proj}).
Trait Implementations§
Source§impl Clone for LoraTarget
impl Clone for LoraTarget
Source§fn clone(&self) -> LoraTarget
fn clone(&self) -> LoraTarget
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for LoraTarget
impl Debug for LoraTarget
Source§impl PartialEq for LoraTarget
impl PartialEq for LoraTarget
impl Copy for LoraTarget
impl Eq for LoraTarget
impl StructuralPartialEq for LoraTarget
Auto Trait Implementations§
impl Freeze for LoraTarget
impl RefUnwindSafe for LoraTarget
impl Send for LoraTarget
impl Sync for LoraTarget
impl Unpin for LoraTarget
impl UnwindSafe for LoraTarget
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.