Remote Lead Data Engineer — ETL & Data Lake
Summary
Lead a team to build and maintain ETL pipelines and a data lake for a marketing analytics platform using AWS S3, Airflow, and Athena.
AgileEngine seeks a Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform. You will decide on partitioning strategies, file formats, schema, and near-real-time processing for OLAP workloads on an S3-backed data lake.
You will design ETL pipelines, orchestrate with Airflow, and lead senior developers while enforcing code quality standards. You will drive the AWS data stack including S3, Athena, and EKS, collaborating with DevOps to