Data Engineer
Posted 6
views
Summary
Data Engineer at Neutral Street in Singapore building petabyte-scale, high-throughput pipelines for market tick data that power quantitative research and backtesting. Day to day: data ingestion/processing, quality and availability across global regions, internal tools/APIs for quant researchers, and database/storage optimization using Python/Rust/Go, ClickHouse or kdb+, Kafka/Flink, and AWS/GCP.
Architect and maintain high-throughput data pipelines for market tick data, powering our quantitative research and backtesting engines.
Responsibilities
- Implement petabyte-scale data ingestion and processing pipelines
- Ensure data quality, consistency, and availability across global regions
- Develop tools and APIs for quantitative researchers
- Optimize database performance and storage costs
Requirements
- Strong programming skills in Python, Rust, or Go
- Experience with time-series databases (e.g., ClickHouse, kdb+) and distributed systems
- Knowledge of stream processing frameworks (Kafka, Flink)
- Experience with cloud infrastructure (AWS or GCP)