Lead Data Engineer - Remote Analytics & Data Lake
Summary
Lead a team building and scaling an S3-backed data lake and OLAP pipelines for a marketing analytics platform using Airflow, Athena, and AWS EKS.
AgileEngine is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform. You will make architectural decisions around partitioning strategy, file formats, schema design, and near-real-time processing for OLAP-oriented workloads built on an S3-backed data lake.
You will design and govern ETL pipelines, define DAG-based orchestration strategies using Airflow, drive the AWS data stack including Athena and EKS, and lead a team