Data Engineer
Posted Updated 5
views
Summary
Build and maintain pipelines that ingest, normalize, and deliver real-time and historical market data from centralized and decentralized exchanges using Python, Rust, and AWS.
Own pipelines that turn raw centralized and decentralized exchange feeds into reliable market data, including ingestion, normalization, reconciliation, storage, APIs, feeds, service levels, monitoring, and performance-critical processing.
Responsibilities
- Build and maintain data ingestion from CEX and DEX venues using WebSocket, REST, and on-chain feeds
- Normalize, validate, and reconcile market data, including gap detection, deduplication, and schema drift handling
- Own storage and delivery for time-series and historical datasets, APIs, feeds, and SLAs
- Build monitoring and alerting for data quality
- Maintain fast performance-critical data paths
Requirements
- 2–4 years building production data infrastructure
- Strong Python and Rust skills, particularly Polars
- AWS and command-line experience
- Strong SQL and data-quality expertise
- Advanced degree in mathematics, statistics, physics, computer science, engineering, or a similar field
- Enthusiasm for systematic research and market microstructure
- Prior high-frequency trading experience
- Sharp, curious, low-ego working style