Lead Data Engineer ID71008
Summary
Lead a data engineering team to design and implement AWS-based ETL pipelines, schema, and near real-time processing with Airflow, while mentoring developers and enforcing code quality.
- Collaborate with DevOps on requirements
- Define data partitioning strategy
- Design ETL pipelines
- Design file formats and schema
- Drive AWS data stack architecture
- Implement near real time processing
- Lead engineering team and mentor developers
- Orchestrate batch workflows with Airflow
- Review pull requests and enforce code quality
- Validate and govern data pipelines
Perks/Benefits:
- Annual learning budget
- Collaborative culture
- Flexible hours
- Internal TechTalks
- Mentorship
- No micromanagement
- People focused support
- Remote work
- Well-being programs