pub enum NemotronSsmQuant {
Nvfp4,
Fp8,
Bf16,
}Expand description
SSM weight quantization format detected at load time.
Variants§
Nvfp4
NVFP4: has weight_scale + weight_scale_2 (Nano NVFP4 model).
Fp8
FP8 E4M3: has weight_scale but no weight_scale_2 (Super 120B).
Bf16
BF16: no weight_scale at all (BF16 layers adjacent to attention).
Trait Implementations§
Source§impl Clone for NemotronSsmQuant
impl Clone for NemotronSsmQuant
Source§fn clone(&self) -> NemotronSsmQuant
fn clone(&self) -> NemotronSsmQuant
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for NemotronSsmQuant
impl Debug for NemotronSsmQuant
Source§impl PartialEq for NemotronSsmQuant
impl PartialEq for NemotronSsmQuant
impl Copy for NemotronSsmQuant
impl Eq for NemotronSsmQuant
impl StructuralPartialEq for NemotronSsmQuant
Auto Trait Implementations§
impl Freeze for NemotronSsmQuant
impl RefUnwindSafe for NemotronSsmQuant
impl Send for NemotronSsmQuant
impl Sync for NemotronSsmQuant
impl Unpin for NemotronSsmQuant
impl UnwindSafe for NemotronSsmQuant
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.