Expand description
Data Store: abstraction for moving data between workers.
Separates WHERE data lives from HOW it’s processed. Workers use DataRef to reference data without materializing it.
Structs§
- Local
Data Store - Local filesystem data store.
- Store
Meta - Metadata about a stored value, queryable without loading data.
Enums§
- DataRef
- A reference to data that may live in different places. Workers exchange DataRefs instead of raw data.
- Storage
Config - Storage configuration for an investigation/pipeline.
- Stream
Format - Stream data format.
Constants§
- INLINE_
THRESHOLD_ BYTES - Maximum payload size for inline WebSocket transport. Payloads above this threshold are uploaded via HTTP bulk or DataStore.
Traits§
- Data
Store - The DataStore trait: put/get/stream data across workers.
Functions§
- slice_
tensor_ rows - Slice rows
[start..start+len)from a tensor value.