Senior Data Engineer – OLAP Data Lake & Airflow
Summary
Owns and builds an S3-backed OLAP data lake and Airflow-driven ETL pipelines for a marketing analytics platform, choosing formats, schemas, and near-real-time processing.
AgileEngine, LLC. is seeking a Lead Data Engineer to own the data pipeline and analytical architecture for a large-volume marketing analytics platform.
You will decide partitioning strategy, file formats, schema, and near-real-time processing for OLAP workloads on an S3-backed data lake and drive the AWS data stack including Athena and EKS. You will lead senior developers, govern ETL pipelines, and define DAG-based workflows with Airflow, guiding architectural discussions and enforcing code