Struct DerivedWeights 

pub struct DerivedWeights { /* private fields */ }

Per-model memo of derived weight encodings.

One map per derivation rather than one keyed by (ptr, kind): the value types differ, and a wrong-kind hit would be exactly the class of bug this type exists to remove.

Implementations

impl DerivedWeights

pub fn new() -> Self

pub fn get_ptr(&self, kind: Derivation, key: u64) -> Option<u64>

Raw memo read. get_or_build_ptr is the form to prefer; this pair exists because the dispatch helpers allocate and launch between the lookup and the store, and expressing that as a closure would mean indenting several hundred lines of kernel-launch code for no gain.

pub fn insert_ptr(&self, kind: Derivation, key: u64, value: u64)

pub fn get_pair(&self, kind: Derivation, key: u64) -> Option<(u64, u64)>

pub fn insert_pair(&self, kind: Derivation, key: u64, value: (u64, u64))

pub fn get_or_build_ptr( &self, kind: Derivation, key: u64, build: impl FnOnce() -> Result<u64>, ) -> Result<u64>

Look up a single-pointer derivation, computing it on a miss.

build runs outside the lock: it launches kernels and allocates, and holding a Mutex across that would serialise every layer’s first touch of a weight behind one another. A duplicate build under a race wastes an allocation, which is why the loser’s value is kept rather than swapped — the first writer’s pointer is the one other threads may already hold.

pub fn get_or_build_pair( &self, kind: Derivation, key: u64, build: impl FnOnce() -> Result<(u64, u64)>, ) -> Result<(u64, u64)>

Look up a pair-valued derivation, computing it on a miss.

pub fn len(&self) -> usize

Total memoized entries, for diagnostics and for asserting in tests that a fresh model starts empty.

pub fn is_empty(&self) -> bool

Trait Implementations

impl Debug for DerivedWeights

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for DerivedWeights

fn default() -> DerivedWeights

Returns the “default value” for a type.

impl ModelResource<dyn GpuBackend> for DerivedWeights

Release every derived allocation.

The KEYS are the original weight pointers — owned by the WeightStore and freed by it. Only the VALUES are derivations this cache allocated, so only those are freed here. Freeing a key would be a double-free of a weight.

fn label(&self) -> &'static str

Human name, for the teardown report and for attributing a failure.

fn release(&mut self, gpu: &dyn GpuBackend) -> Result<()>

Release everything this owns. Must be idempotent: the host calls it, and a Drop backstop may call it again.