Lead Data Engineer: AWS Data Lake & Airflow Architect
Summary
Lead a team to design and maintain an S3-backed data lake and Airflow-based ETL pipelines for a marketing analytics platform, optimizing partitioning, file formats, and near-real-time processing.
AgileEngine is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a large-scale marketing analytics platform. You will drive partitioning strategy, file formats, and near-real-time processing for OLAP workloads on an S3-backed data lake.
You will design and govern ETL pipelines, define DAG-based orchestration with Airflow, and lead a team of senior developers while upholding code quality standards.