Lead Data Engineer ID71008
Summary
Lead a small team to design and build AWS-based ETL pipelines, data lakes, and real-time processing systems while mentoring engineers and enforcing code quality standards.
- Collaborate with DevOps on requirements
- Define partitioning strategy
- Define pipeline dependencies and triggering
- Design ETL pipelines
- Design data lake file formats
- Design schema and data types
- Drive AWS data stack architecture
- Enforce code quality standards
- Extract transform validate data
- Implement near real time processing
- Lead and mentor developers
- Orchestrate batch workflows with DAGs
- Review pull requests
- Set team standards for AI tooling use
Perks/Benefits:
- Flexible hours
- Learning budget
- Mentorship
- Modern collaborative culture
- Performance and compensation reviews
- Remote work
- Support programs
- Techtalks
- Well-being programs