Skip to content

aetelier_connect::workers::data_worker

Lean ingestion-only data worker (no preprocessing). Lea ingestion-only data worker.

DataWorker is the core runtime for the data_worker binary. It establishes a persistent WebSocket connection to a single exchange + symbol pair, decodes raw frames through the existing exchange decoders, and publishes them — without any pre-processing — to configured output sinks.

Design

Concern Approach
Output Pluggable OutputSinks (channel, terminal, parquet)
Processing None — raw decoded events
Reconnection Delegated to IngestionCore
Gap tracking Delegated to IngestionCore
Stale detection Delegated to IngestionCore

Event classification

Each decoded ExchangeEvent variant is mapped to a canonical topic name. The mapping is exchange-specific:

Exchange Event Topic
Bybit OrderbookData orderbook.{depth}.{symbol}
Bybit TradeData publicTrade.{symbol}
Bybit LiquidationData lquidation.all.{symbol}
Bybit TickerData (funding) funding.all.{symbol}
Bybit TickerData (OI) open_interest.all.{symbol}

| Binance | DepthUpdate | orderbook.{depth}.{symbol} | | Binance | DepthSnapshot | orderbook.{depth}.{symbol} | | Binance | TradeData | trade.all.{symbol} |

| Coinbase | OrderbookData | orderbook.{depth}.{symbol} | | Coinbase | TradeData | trade.all.{symbol} |

| Kraken | OrderbookData | orderbook.{depth}.{symbol} | | Kraken | TradeData | trade.all.{symbol} |

Skeleton API reference

This page lists the public items in aetelier_connect::workers::data_worker with a one-line summary each. Signatures and source live in the SDK repository.

Structs

Item Summary
DataWorker A single-symbol raw data ingestion worker.
DataWorkerReport Summary statistics returned when a DataWorker finishes.