Lead Data Engineer ID71008
Summary
Lead a team to design and implement scalable data pipelines, AWS data lakes, and real-time processing workflows using Airflow and DAGs.
- Collaborate with DevOps on requirements
- Define file formats and schema
- Define partitioning strategy
- Design DAG batch workflows
- Design analytical data architecture
- Drive AWS data lake architecture
- Implement near real time processing
- Lead developers and align engineering practices
- Orchestrate data processing with Airflow
- Own ETL pipelines
- Review pull requests and enforce code quality
Perks/Benefits:
- Annual learning budget
- Collaborative culture
- Flexible hours
- Growth opportunities
- Internal TechTalks
- Mentorship
- People focused support
- Remote work
- Well-being programs