Skip to main content

Module store

Module store 

Source
Expand description

Data Store: abstraction for moving data between workers.

Separates WHERE data lives from HOW it’s processed. Workers use DataRef to reference data without materializing it.

Structs§

LocalDataStore
Local filesystem data store.
StoreMeta
Metadata about a stored value, queryable without loading data.

Enums§

DataRef
A reference to data that may live in different places. Workers exchange DataRefs instead of raw data.
StorageConfig
Storage configuration for an investigation/pipeline.
StreamFormat
Stream data format.

Constants§

INLINE_THRESHOLD_BYTES
Maximum payload size for inline WebSocket transport. Payloads above this threshold are uploaded via HTTP bulk or DataStore.

Traits§

DataStore
The DataStore trait: put/get/stream data across workers.

Functions§

slice_tensor_rows
Slice rows [start..start+len) from a tensor value.