DATA ENGINEER SUPERVISOR
Summary
The Data Engineer Supervisor designs and maintains robust data pipelines and infrastructure to ensure data integrity and scalability. The role requires expertise in data lakehouse technologies like Snowflake, Databricks, and Apache Spark.
- Design, develop, and maintain robust data pipelines to move data from various databases into our data warehouse.
- Implement automated testing and monitoring to ensure data integrity, security, and compliance with data governance policies.
- Identify, design, and implement internal process improvements: redesign infrastructure for greater scalability, optimize data delivery, and automate manual processes.
- Work with stakeholders to support data infrastructure needs and assist with technical issues.
Job Responsibility
- Design, develop, and maintain robust data pipelines to move data from various databases into our data warehouse.
- Implement automated testing and monitoring to ensure data integrity, security, and compliance with data governance policies.
- Identify, design, and implement internal process improvements: redesign infrastructure for greater scalability, optimize data delivery, and automate manual processes.
- Work with stakeholders to support data infrastructure needs and assist with technical issues.
Qualifications
- Bachelor degree in Computer Science, Information System, Data Science, or similar.
- A minimum of 5 years of experience as a Data Engineer is required, preferably in a multinational company.
- A minimum of 2 years of experience handling enterprise data lakehouses for data science, such as Snowflake and Databricks.
- Extensive knowledge of Apache Spark, Apache Iceberg, Polaris Catalogue, Range (Governance), or Phyton.
- Team player and problem solver.
- Good documentation and presentation skill.