Lead Data Engineer ID71008
Summary
Lead a team to design and build scalable ETL pipelines, data lakes, and OLAP architectures on AWS, using Airflow and near real-time processing.
- Collaborate with DevOps on requirements
- Create partitioning and schema strategies
- Define DAG dependencies and triggering
- Define OLAP data architecture
- Design Airflow DAG workflows
- Design ETL pipelines
- Drive AWS data lake architecture
- Extract, transform, and validate data
- Implement near real time processing
- Lead and mentor developers
- Review pull requests and enforce code quality
Perks/Benefits:
- Flexible hours
- Learning budget
- Mentorship
- People focused support
- Remote work
- Techtalks
- Well-being programs