Glm5NextDsaConfig

Struct Glm5NextDsaConfig 

Source
pub struct Glm5NextDsaConfig {
Show 13 fields pub hidden: usize, pub index_heads: usize, pub index_head_dim: usize, pub index_kpool: usize, pub index_topk: usize, pub always_select_tail: bool, pub local_heads: usize, pub q_lora_rank: usize, pub kv_lora_rank: usize, pub qk_nope_head_dim: usize, pub qk_rope_head_dim: usize, pub v_head_dim: usize, pub max_context: usize,
}
Expand description

DSA geometry for one layer, read from the checkpoint config — never defaulted.

Head counts are per-rank local for the MLA side and full for the indexer, which is replicated. See tp for why.

Fields§

§hidden: usize§index_heads: usize§index_head_dim: usize§index_kpool: usize§index_topk: usize§always_select_tail: bool§local_heads: usize

Attention heads this rank owns.

§q_lora_rank: usize§kv_lora_rank: usize§qk_nope_head_dim: usize§qk_rope_head_dim: usize

Zero on GLM-5.3. Kept explicit so a nonzero value is a loud change.

§v_head_dim: usize§max_context: usize

Longest context a sequence’s indexer cache is reserved for, in tokens — the serve’s --max-seq-len. Not a kernel limit (the top-k select is tiled); an ALLOCATION, and the biggest per-sequence one GLM-5.3 makes. See state::max_dsa_context.

Implementations§

Source§

impl Glm5NextDsaConfig

Source

pub fn from_config(config: &ModelConfig) -> Result<Self>

config carries per-rank-local attention head counts: serve_phases::topology divides num_attention_heads by tp_size before any loader runs.

Source

pub fn qk_head_dim(&self) -> usize

Source

pub fn is_nope(&self) -> bool

True when there is no RoPE section at all — GLM-5.3.

Source

pub fn select_k(&self, n_pools: usize) -> usize

Pools selected per query, capped by how many pools exist.

Source

pub fn out_width(&self) -> usize

Width of the emitted index row; the tail adds kpool - 1 slots.

Source

pub fn kv_cache_dim(&self) -> usize

KV latent cache width. No rope section under NoPE, so this is exactly kv_lora_rank — 512 for GLM-5.3, where DeepSeek-V4-Flash uses 576.

Source

pub fn validate(&self) -> Result<()>

Trait Implementations§

Source§

impl Clone for Glm5NextDsaConfig

Source§

fn clone(&self) -> Glm5NextDsaConfig

Returns a duplicate of the value. Read more
1.0.0 · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for Glm5NextDsaConfig

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl PartialEq for Glm5NextDsaConfig

Source§

fn eq(&self, other: &Glm5NextDsaConfig) -> bool

Tests for self and other values to be equal, and is used by ==.
1.0.0 · Source§

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.
Source§

impl Copy for Glm5NextDsaConfig

Source§

impl Eq for Glm5NextDsaConfig

Source§

impl StructuralPartialEq for Glm5NextDsaConfig

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
§

impl<Q, K> Equivalent<K> for Q
where Q: Eq + ?Sized, K: Borrow<Q> + ?Sized,

§

fn equivalent(&self, key: &K) -> bool

Compare self to key and return true if they are equal.
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

§

impl<T> Instrument for T

§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided [Span], returning an Instrumented wrapper. Read more
§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

§

fn vzip(self) -> V

§

impl<T> WithSubscriber for T

§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a [WithDispatch] wrapper. Read more
§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a [WithDispatch] wrapper. Read more