Lead Data Engineer - Remote, Big-Scale Analytics Leader
Summary
Lead a team building and optimizing large-scale marketing analytics pipelines on AWS, designing ETL workflows with Airflow and S3-backed data lakes for near-real-time processing.
AgileEngine, LLC. is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform.
You will drive partitioning strategy, file formats, and near-real-time processing on an S3-backed data lake, designing ETL pipelines and DAGs with Airflow. You will lead a team of senior developers, work with AWS data services (Athena, EKS), and ensure code quality while aligning with the client’s engineering practices.