Lead Data Engineer — Remote Data Pipeline Architect
Summary
Lead a team to design and maintain high-volume marketing analytics pipelines using S3 data lakes, Airflow orchestration, and near-real-time processing on Athena/EKS.
AgileEngine is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform. You will drive ETL design, partitioning strategy, and near-real-time processing on an S3-backed data lake, while guiding a team of senior developers.
You will define DAG-based orchestration with Airflow or comparable tools, work with Athena/EKS, and enforce code quality across the team in a remote setup.