Data Engineer
Posted Updated
Description
Responsibilities:
- Contribute to the design, development, testing, deployment, and support of data pipelines and data lakes.
- Design, build and manage complex large-scale data architectures.
- Drive technical direction and set best practices for data governance, quality, security, and data modelling.
- Mentor senior and junior data engineers, fostering a culture of engineering excellence, code review, and high-quality documentation.
- Collaborate with your squad, Product Managers, Designers, QA, Operations, and other stakeholders to understand requirements and articulate technical decisions and outcomes.
Requirements:
- Familiarity with at least one of the following languages: Scala, Python, or SQL.
- Familiarity with at least one of the following: Spark, Hive, or Presto.
- Familiarity with data engineering methods and their application at scale.
- Familiarity with at least one of the following cloud providers: Amazon Web Services (AWS), Google Cloud Compute (GCP), or Microsoft Azure.
- Solid experience architecting Data systems.
- Experience working on complex projects at an organisation level, coordinating work between multiple teams.
- Familiarity with data quality and observability tools.
- Demonstrated ability to lead technical data teams, set direction, and grow engineers.
Desirable Skills:
- Familiarity with Databricks or Snowflake products.
- Familiarity with Terraform, CloudFormation, or another infrastructure as code (IaC) tool.
- Experience operating as a Principal Engineer / Data Architect.
Required Education:
- Bachelor's degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience.
- Minimum of 12+ years of related work experience.
Skills
Sign in to read and join the discussion.