pub enum DflashQuantization {
Bf16,
Fp8Weights,
}Expand description
Drafter-side weight precision. Defaults to BF16. Phase G (2026-05-28)
adds Fp8Weights, gated by env var ATLAS_DFLASH_DRAFTER_FP8. The
historical SM12.x acceptance collapse note applied to drafter FP8 KV
cache (different concern — bidirectional attention math); Phase G
targets weight FP8 only, so the risk surface is dynamic-range loss
in MLP intermediate activations, which per-row scales mitigate.
--mtp-quantization fp8 is still not honored for the DFlash drafter.
Variants§
Bf16
Fp8Weights
Weight-only FP8: q/k/v/o/gate/up/down BF16 → FP8 E4M3 with per-row
f32 scales at model load. Activations stay BF16; KV cache stays
BF16. GEMMs use fp8_gemm_n128 (BF16 × FP8 → BF16).
Trait Implementations§
Source§impl Clone for DflashQuantization
impl Clone for DflashQuantization
Source§fn clone(&self) -> DflashQuantization
fn clone(&self) -> DflashQuantization
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for DflashQuantization
impl Debug for DflashQuantization
Source§impl PartialEq for DflashQuantization
impl PartialEq for DflashQuantization
impl Copy for DflashQuantization
impl Eq for DflashQuantization
impl StructuralPartialEq for DflashQuantization
Auto Trait Implementations§
impl Freeze for DflashQuantization
impl RefUnwindSafe for DflashQuantization
impl Send for DflashQuantization
impl Sync for DflashQuantization
impl Unpin for DflashQuantization
impl UnwindSafe for DflashQuantization
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.