Lead Data Engineer ID71008
Summary
Lead a data engineering team to design and implement ETL pipelines, data lakes, and real-time processing on AWS, using Airflow for orchestration and ensuring code quality.
- Collaborate with DevOps on AWS requirements
- Define file formats and schema for OLAP workloads
- Design and own ETL pipelines
- Design data lake partitioning strategy
- Implement near real time processing architecture
- Lead engineering team and provide technical guidance
- Orchestrate batch workflows with Airflow DAGs
- Review pull requests and enforce code quality
Perks/Benefits:
- Annual learning budget
- Collaborative culture
- Flexible hours
- Learning budget
- Mentorship
- People focused support
- Remote work
- Techtalks
- Well-being programs
- Zero micromanagement