Lead Data Engineer

We are seeking an experienced EL1 Data Acquisition Engineer / Senior Data Engineer to join a major enterprise data warehouse program.

This is a senior, hands-on position combining data engineering, technical leadership, data modelling, SQL/ETL development and delivery governance. You will provide technical guidance to developers, review data designs and models, and help mature data engineering and release practices.

Key Responsibilities

• Provide technical leadership to data delivery teams through design reviews, technical workshops and implementation guidance.
• Design and implement the acquisition and integration of new data sources into the enterprise data platform.
• Review and improve data delivery frameworks to increase performance, scalability and speed of delivery.
• Own technical implementation of new data from analysis through to production delivery.
• Develop and maintain complex SQL, analytical and ETL code.
• Design and maintain data dictionaries, data models and technical documentation.
• Review and approve data designs, models and development approaches.
• Define and improve release processes, coding standards and development best practices.
• Conduct peer reviews and knowledge-transfer sessions for developers.
• Analyse, understand and estimate complex user requirements.
• Manage and prioritise technical work items.
• Work closely with data consumers, database developers, testers and IT support teams.
• Drive continuous improvement across development, documentation, data modelling and delivery practices.
• 5+ year experience in Snowflake and AWS
• Strong experience with at least 2 of the following data warehouse/platform technologies- MS SQL Server, Teradata ,Amazon Redshift, Databricks
• Advanced SQL development skills, including the ability to analyse and reverse-engineer complex SQL.
• Strong programming capability with languages such as Python, SAS, R or Java.
• Strong understanding of ETL/data integration development.
• Ability to read, interpret and review data models and technical specifications.
• Experience reviewing/auditing data engineering code.
• Good understanding of DevOps processes and tools.
• Strong knowledge of version control and appropriate development practices.
• Ability to provide technical guidance, peer reviews and mentoring to other developers.

Highly Desirable

• Experience with AWS cloud data technologies, including AWS S3 and AWS Glue or similar.
• Experience with SAS and Excel.
• Experience with metadata/model-driven data modelling frameworks.
• Previous experience working with large-scale enterprise data warehouse environments.