Lead Data Engineer ID71008
Summary
Lead a data engineering team to design AWS-based data lakes, ETL pipelines, and real-time processing with Kubernetes and Athena, while mentoring developers and enforcing code quality.
- Collaborate with DevOps on requirements
- Configure pipeline structure dependencies and triggers
- Define partitioning strategy
- Design ETL pipelines
- Design schema and data types
- Drive AWS data lake architecture
- Implement near real time processing
- Integrate with Athena query engine
- Lead engineering team and mentor developers
- Manage Kubernetes-based workloads
- Orchestrate batch workflows with DAGs
- Review pull requests and enforce code quality
- Validate data
Perks/Benefits:
- Annual learning budget
- Flexible hours
- Internal TechTalks
- Mentorship
- People focused support
- Performance reviews
- Remote work
- Well-being programs
- Zero micromanagement