Lead Data Engineer ID71008
Summary
Lead a team to design and implement AWS-based data pipelines, ETL workflows, and real-time analytics using Airflow and data lake schemas.
- Collaborate with DevOps for functional non functional requirements
- Define partitioning strategy for OLAP workloads
- Design Airflow DAG workflows for scheduled batch processing
- Design ETL pipelines for extracting transforming validating data
- Design schema and data type strategy for data lake
- Drive AWS data stack architecture decisions
- Guide developers and align engineering practices
- Implement near real time processing for analytics
- Orchestrate DAG dependencies and triggering strategy
- Review pull requests and enforce code quality
Perks/Benefits:
- Annual learning budget
- Challenging projects
- Collaborative culture
- Flexible hours
- Mentorship
- People focused support
- Remote work
- Techtalks
- Well-being programs