Q12_SIZING_STREAMS

Constant Q12_SIZING_STREAMS 

Source
pub const Q12_SIZING_STREAMS: usize = 8;
Expand description

Streams assumed when provisioning scratch for the Q12 kernel-batched prefill path. The per-stream metadata region scales with N, so the scratch buffer must be sized for a realistic max concurrent batched streams. Beyond this, check_kernel_batched_eligible falls the dispatch back to the per-stream path (which respects the same arena cap), so this bound only governs how often the fast path is available — never safety.