Lead Data Engineer - Remote OLAP Pipeline Architect
Summary
Lead a team to design and maintain high-volume marketing analytics pipelines using AWS S3, Athena, EKS, and Airflow for near-real-time processing.
AgileEngine, LLC. is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a high-volume marketing analytics platform.
You will guide ETL design, partitioning, and near-real-time processing on an S3-backed data lake, while shaping DAGs in Airflow and championing best practices across a team of senior developers. You will drive the AWS data stack (S3, Athena, EKS) and collaborate with DevOps to meet functional and non-functional requirements.