Lead Data Engineer ID71008
Summary
Lead a data engineering team to design and implement AWS-based data lakes, ETL pipelines, and OLAP architectures using Airflow, serverless query engines, and real-time processing.
- Define file formats schema and data type strategy
- Define partitioning strategy
- Define pipeline dependencies and triggering
- Design ETL pipelines
- Design OLAP oriented data architecture
- Drive AWS data lake architecture
- Extract transform validate data
- Implement near real time processing
- Lead engineering team and enforce engineering practices
- Orchestrate batch workflows with Airflow DAGs
- Query data using serverless query engines
- Review pull requests and enforce code quality
Perks/Benefits:
- Annual learning budget
- Collaborative culture
- Flexible hours
- Mentorship
- Modern projects
- People focused support
- Remote work
- Techtalks
- Well-being programs