Lead Data Engineer ID71008
Summary
Lead a team to design and build scalable ETL pipelines, data lakes, and real-time OLAP systems on AWS, using Airflow for orchestration and mentoring engineers.
- Define pipeline dependencies and triggering strategy
- Define schema and data type strategy
- Design ETL pipelines
- Design data lake partitioning strategy
- Drive AWS data stack architecture
- Enforce code quality standards
- Implement near real time OLAP processing
- Lead and mentor development team
- Orchestrate batch workflows with Airflow DAGs
- Partner with DevOps on functional requirements
- Review pull requests
Perks/Benefits:
- Annual performance reviews
- Flexible hours
- Learning budget
- Mentorship
- People focused support
- Remote work
- Supportive culture
- Techtalks
- Wellbeing programs