pub struct Glm5NextDsaWorkspace { /* private fields */ }Expand description
Scratch reused across decode steps. Allocated once per layer.
Implementations§
Source§impl Glm5NextDsaWorkspace
impl Glm5NextDsaWorkspace
Sourcepub fn new(
gpu: &dyn GpuBackend,
cfg: &Glm5NextDsaConfig,
max_rows: usize,
) -> Result<Self>
pub fn new( gpu: &dyn GpuBackend, cfg: &Glm5NextDsaConfig, max_rows: usize, ) -> Result<Self>
max_rows is the widest speculative verify this workspace serves. The projection
buffers, attn_out and the selector’s OUTPUT row scale with it; the indexer staging
rows, the block table and the selector’s within-pass temporaries stay per-row,
because Glm5NextDsaLayer::decode_k still SELECTS one token at a time.
Auto Trait Implementations§
impl Freeze for Glm5NextDsaWorkspace
impl RefUnwindSafe for Glm5NextDsaWorkspace
impl Send for Glm5NextDsaWorkspace
impl Sync for Glm5NextDsaWorkspace
impl Unpin for Glm5NextDsaWorkspace
impl UnwindSafe for Glm5NextDsaWorkspace
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more