Lead Data Engineer ID71008
Summary
Lead a team to design and implement AWS-based data pipelines, ETL workflows in Airflow, and real-time analytics architectures while enforcing code quality and engineering best practices.
- Configure pipeline structure dependencies and triggering strategy
- Define partitioning strategy file formats schema strategy
- Design DAG based batch workflows in Airflow
- Design and own ETL pipelines
- Drive AWS data lake and analytics architecture
- Extract transform validate data from databases and APIs
- Implement near real time processing for OLAP workloads
- Lead engineering team and ensure alignment with engineering practices
- Partner with DevOps to clarify requirements
- Review pull requests enforce code quality standards
Perks/Benefits:
- Annual learning budget
- Annual performance reviews
- Flexible hours
- Internal tech talks
- Mentorship
- People focused support
- Remote work
- Well-being programs