Lead Data Engineer - Remote, OLAP & Airflow Lead
Summary
Lead a team building and optimizing an S3-backed OLAP pipeline for a marketing analytics platform using Airflow, Athena, and AWS EKS.
AgileEngine is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform. You will steer partitioning, file formats, and near-real-time processing for OLAP workloads on an S3-backed data lake, and lead a team of senior developers.
You will define DAG-based orchestration with Airflow, drive the AWS data stack including Athena and EKS, review PRs, enforce quality, and collaborate with DevOps.