Lead Data Engineer ID71008
Summary
Lead a team to design and build scalable data pipelines and OLAP systems using AWS, Airflow, and serverless tools, while mentoring engineers and enforcing best practices.
- Architect partitioning strategy and schema design for OLAP workloads
- Build data lake architecture on S3 and serverless query engines
- Design ETL pipelines for data extraction transformation validation
- Drive AWS data ecosystem architecture with DevOps
- Implement near real time processing for analytical data systems
- Lead and mentor developers and align engineering practices
- Manage scheduled batch pipeline structure dependencies and triggering strategy
- Orchestrate batch workflows using Airflow DAGs
- Review pull requests and enforce code quality standards
Perks/Benefits:
- Annual learning budget
- Flexible hours
- Internal TechTalks
- Mentorship
- People focused support
- Remote work
- Wellbeing programs