Lead Data Engineer ID71008
Summary
Lead a team to design and implement scalable data pipelines, OLAP architectures, and real-time processing on AWS, while mentoring engineers and enforcing code quality.
- Define partitioning strategy and file formats
- Define pipeline dependencies and triggering strategy
- Design OLAP analytical data architecture
- Design and govern data lake based pipelines
- Design and own ETL pipelines
- Design batch workflows using DAG orchestration
- Drive AWS data stack integrations
- Implement near real time processing
- Implement schema and data type strategy
- Lead and mentor developers
- Review pull requests and enforce code quality
Perks/Benefits:
- Annual learning budget
- Flexible hours
- Mentorship
- Remote work
- Supportive culture
- Techtalks
- Well-being programs