Lead Data Engineer ID71008
Summary
Lead a team building and optimizing AWS-based data pipelines, ETL workflows, and Airflow orchestration to enable near real-time analytics and batch processing.
- Create Airflow DAG workflows
- Define partitioning file formats schema strategy
- Design ETL pipelines
- Drive AWS data lake analytics architecture
- Extract transform validate data
- Implement near real time processing
- Mentor developers align engineering practices
- Orchestrate scheduled batch processing
- Partner with DevOps on requirements
- Review pull requests enforce code quality
Perks/Benefits:
- Collaborative culture
- Flexible hours
- Internal tech talks
- Learning budget
- Mentorship
- Remote work
- Supportive environment
- Well-being programs