Lead Data Engineer ID71008
Summary
Lead a team to design and build AWS-based data pipelines, ETL workflows, and real-time processing systems using Airflow and Athena.
- Collaborate with DevOps on infrastructure requirements
- Define partitioning strategy
- Design ETL pipelines
- Design file formats and schema design
- Drive AWS data lake architecture
- Enforce code quality in pull request reviews
- Implement near real time processing
- Integrate Athena query workflows
- Lead developers and ensure engineering alignment
- Orchestrate batch workflows with Airflow DAGs
Perks/Benefits:
- Flexible hours
- Learning budget
- Mentorship
- People focused support
- Performance reviews
- Remote work
- Techtalks
- Well-being programs