Lead Data Engineer ID71008
Summary
Lead a team to design and implement AWS-based data pipelines, ETL workflows, and real-time processing using Airflow, ensuring data quality and team code standards.
- Define DAG dependencies and triggers
- Define partitioning strategy
- Design ETL pipelines
- Design file formats and schema
- Drive AWS data lake architecture
- Implement near real time processing
- Lead engineering team and enforce code quality
- Orchestrate scheduled batch workflows with Airflow
- Review pull requests and ensure maintainability
- Validate extracted transformed data
Perks/Benefits:
- Annual learning budget
- Flexible hours
- Internal TechTalks
- Mentorship
- People focused support
- Performance and compensation reviews
- Remote work
- Well-being programs