Senior Data Platform Engineer for Scalable Pipelines
Summary
Designs and builds scalable batch and streaming data pipelines in Python, Spark, and ClickHouse, and manages Airflow workflows for scheduling and monitoring.
Atolls is seeking a Data Engineer to join the Data Products team to shape the future of internal data products. You will design, build and optimize batch and streaming data pipelines using Python, Spark, and ClickHouse, and operate Airflow workflows for scheduling and monitoring.
You will model data systems for analytics with SQL and dbt, implement Terraform-based IaC, and containerize services with Docker and Kubernetes, collaborating with analysts and other teams to translate requirements into