pub struct DflashBuildArgs<'a> {
pub drafter_store: &'a WeightStore,
pub drafter_config: DflashConfig,
pub gamma: Option<usize>,
pub window_size: Option<usize>,
}Expand description
DFlash speculative-decoding build arguments. None for non-DFlash runs;
Some(...) carries the drafter’s separate WeightStore, parsed
config.json, and CLI overrides for γ and the sliding-window size.
Construction order: the caller (spark-server::main) loads the drafter
checkpoint into a fresh WeightStore via the same WeightStore::load
path used for the target, then parses config.json via
crate::weight_loader::dflash_loader::parse_dflash_config. Both inputs
flow through to build_model which validates dimensions against the
target before constructing crate::layers::BlockDiffusionDraftHead.
Fields§
§drafter_store: &'a WeightStore§drafter_config: DflashConfig§gamma: Option<usize>§window_size: Option<usize>Auto Trait Implementations§
impl<'a> Freeze for DflashBuildArgs<'a>
impl<'a> RefUnwindSafe for DflashBuildArgs<'a>
impl<'a> Send for DflashBuildArgs<'a>
impl<'a> Sync for DflashBuildArgs<'a>
impl<'a> Unpin for DflashBuildArgs<'a>
impl<'a> UnwindSafe for DflashBuildArgs<'a>
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more