PleIdDims

Struct PleIdDims 

Source
pub struct PleIdDims {
    pub ngram_size: usize,
    pub heads_per_ngram: usize,
    pub multipliers: Vec<u64>,
    pub head_vocab_sizes: Vec<u64>,
    pub head_offsets: Vec<u64>,
    pub eos_token_id: u32,
}
Expand description

Geometry for one PLE site, read from the checkpoint rather than derived.

multipliers, head_vocab_sizes and head_offsets are all SHIPPED (ple_embedding.layer_multipliers / .ngram_heads_vocab_sizes / .ngram_heads_offsets). The reference can derive them — from SplitMix64 and a prime search — and bench/qwen4_exp/ple_golden.py confirms the derivation reproduces the shipped values exactly. Reading them is still right: it cannot drift when the reference does.

Fields§

§ngram_size: usize

ngram_size (3). Also the conv dilation, elsewhere.

§heads_per_ngram: usize

heads_per_ngram (8). Heads are grouped by n-gram order: [0, heads_per_ngram) uses order 2, the next block order 3, and so on.

§multipliers: Vec<u64>

layer_multipliers[ngram_size], always odd.

§head_vocab_sizes: Vec<u64>

ngram_heads_vocab_sizes[ngram_heads] — a distinct prime per head.

§head_offsets: Vec<u64>

ngram_heads_offsets[ngram_heads] — where each head’s range starts in the single concatenated table.

§eos_token_id: u32

Implementations§

Source§

impl PleIdDims

Source

pub fn ngram_heads(&self) -> usize

(ngram_size - 1) * heads_per_ngram — 16 here. Times head_dim (160) this is ple_embed_dim (2560): the head slices are CONCATENATED, not summed as LongCat’s are.

Source

pub fn context_len(&self) -> usize

How many previous tokens a decode step must carry to reproduce prefill’s ids. ngram_size - 1 = 2.

Source

pub fn validate(&self) -> Result<()>

Validate against the reference’s invariants. Called once at load; a mismatch here is a checkpoint we do not understand, not something to paper over.

Trait Implementations§

Source§

impl Clone for PleIdDims

Source§

fn clone(&self) -> PleIdDims

Returns a duplicate of the value. Read more
1.0.0 · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for PleIdDims

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

§

impl<T> Instrument for T

§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided [Span], returning an Instrumented wrapper. Read more
§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

§

fn vzip(self) -> V

§

impl<T> WithSubscriber for T

§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a [WithDispatch] wrapper. Read more
§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a [WithDispatch] wrapper. Read more