Struct VisionItem 

pub struct VisionItem {
    pub groups: Vec<Vec<f32>>,
    pub grid_h: usize,
    pub grid_w: usize,
}

One vision item: a still image, or a video, ready for the encoder.

groups holds the TEMPORAL GROUPS. A still image has exactly one; a video has frames / temporal_patch_size, each group a full grid_h x grid_w patch plane built from temporal_patch_size consecutive frames. Every group is shaped identically — which is why the ViT consumes them on the same path and needs no notion of time.

Grouping lives in the TYPE rather than in a parallel groups_per_item vector carried alongside the pixels. Two vectors that must agree is precisely the failure this feature is exposed to: the pad run, the encoder rows and the MRoPE position stream all have to describe the same item, and a desync between them is silent — fluent output, wrong answer.

Fields

groups: Vec<Vec<f32>>

Per temporal group: [grid_h * grid_w, C * temporal_patch_size * patch^2].

grid_h: usize

Pre-merge patch grid, identical across this item’s groups.

grid_w: usize

Implementations

impl VisionItem

pub fn image(pixels: Vec<f32>, grid_h: usize, grid_w: usize) -> Self

A still image: one temporal group.

pub fn t_len(&self) -> usize

Temporal extent, in groups. 1 for a still.

pub fn pad_count(&self, spatial_merge_size: usize) -> usize

Merged tokens this item occupies in the prompt — the length of its pad run, and the number of embedding rows the encoder will return for it. The two are the same number by construction, which is the invariant the whole splice depends on.

Trait Implementations

impl Clone for VisionItem

fn clone(&self) -> VisionItem

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for VisionItem

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for VisionItem

fn eq(&self, other: &VisionItem) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for VisionItem