Lead Data Engineer ID71008
Summary
Lead a data engineering team to design and implement ETL pipelines, data lake architecture, and real-time processing using S3, DAGs, and schema design.
- Collaborate with DevOps on requirements
- Create pipeline dependencies and triggers
- Define data lake partitioning strategy
- Design ETL pipelines
- Design file formats and schema design
- Enforce code quality standards
- Implement near real time processing
- Lead engineering team
- Manage data lake architecture with S3
- Orchestrate batch workflows with DAGs
- Review pull requests
- Validate data
Perks/Benefits:
- Annual performance reviews
- Flexible hours
- Internal tech talks
- Learning budget
- Mentorship
- People focused support
- Remote work
- Well-being programs