DEFAULT_DIRECT_IO_TENSOR_CAP

Constant DEFAULT_DIRECT_IO_TENSOR_CAP 

Source
pub const DEFAULT_DIRECT_IO_TENSOR_CAP: usize = 5000;
Expand description

Default tensor-count cap for per-shard O_DIRECT. Above this, the fast loader uses buffered reads even when try_direct_io = true. See the field doc on FastSafetensorsLoader::direct_io_tensor_cap.