Skip to main content

Module forward

Module forward 

Source
Expand description

Forward execution strategies for crate::GraphSession.

Each strategy defines HOW input data flows through a compiled graph:

  • Standard — full input at once, with inference caching
  • Stream — chunked input through crate::StreamRun, respecting StreamMode
  • Batched — rows from a [DataStore], batch by batch (memory-bounded)

Structs§

Batched
Batched forward: read rows from a DataStore in fixed-size batches. Keeps memory bounded — only one batch is materialized at a time.
ForwardEnv
What a forward pass runs against, besides the graph and the data.
Standard
Full input at once, with inference caching.
Stream
Chunked input through crate::StreamRun, respecting each filter’s StreamMode.

Traits§

ForwardStrategy
How a forward pass feeds data through the compiled graph.