Remote Lead Data Engineer - ETL, Data Lake, Airflow
Summary
Lead a team to build and maintain ETL pipelines and a data lake for a marketing analytics platform using Airflow, AWS S3, Athena, and EKS.
AgileEngine is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform. You will make architectural decisions around partitioning, file formats, schema, and near-real-time processing for OLAP workloads built on an S3-backed data lake.
You will design and govern ETL pipelines, define DAGs with Airflow, drive the AWS data stack including Athena and EKS, and lead a team of senior developers while enforcing code quality