Struct DecodeMetaLayout 

pub struct DecodeMetaLayout { /* private fields */ }

Derived fixed-stride decode-metadata layout.

Implementations

impl DecodeMetaLayout

pub fn for_max_batch_size(max_batch_size: usize) -> Self

Derive the layout from the serve max_batch_size. Callers gate max_batch_size <= DECODE_META_MAX_ROWS at serve time; this constructor only applies the byte-identity floor.

pub fn rows(&self) -> usize

Row capacity of the metadata block (== the widest padded_n the upload accepts).

pub fn positions_off(&self) -> usize

positions u32 stream offset.

pub fn seq_slot_off(&self) -> usize

Per-request LoRA adapter-slot i32 stream offset.

pub fn slots_off(&self) -> usize

KV slots i64 stream offset (8-byte aligned: 8R).

pub fn seq_lens_off(&self) -> usize

seq_lens i32 stream offset.

pub fn block_table_off(&self) -> usize

Flattened block-table offset (row stride max_blocks · 4 bytes).

pub fn meta_bytes(&self, max_blocks: usize) -> usize

Total bytes of the metadata block for max_blocks blocks per row.

Trait Implementations

impl Clone for DecodeMetaLayout

fn clone(&self) -> DecodeMetaLayout

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for DecodeMetaLayout

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for DecodeMetaLayout

fn eq(&self, other: &DecodeMetaLayout) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for DecodeMetaLayout

impl Eq for DecodeMetaLayout

impl StructuralPartialEq for DecodeMetaLayout