Senior Data Engineer
Summary
Builds and maintains ETL pipelines for energy data using Python, SQL, Snowflake, and dbt to ensure efficient processing and data quality in an agile team.
As a Senior Data Engineer in the Energy sector, you will work together with the team in an agile setting. You bring strong analytical skills and extensive knowledge of data engineering such as planning, building and managing ETL pipelines, experience with tools including Python, SQL, Snowflake/Matillion and Airflow.
Responsibilities:
- Design, build, and maintain ETL pipelines to ensure efficient and reliable data processing across large and complex datasets.
- Develop and optimise data architectures using tools such as Python, SQL, Snowflake/Matillion, dbt and Airflow.
- Implement data management best practices, including partitioning, archiving, and creating efficient data views to enhance performance and scalability.
- Collaborate with stakeholders to define data quality standards, resolve process issues, and ensure smooth data operations within an agile team environment.
Requirements:
- At least 5 years of experience as a Data Engineer;
- Working experience with Snowflake/Matillion;
- Demonstrable experience writing Python and SQL scripts;
- Experience with dbt;
- You have knowledge of and experience with various data modelling techniques;
What We Offer:
- A payroll position
- Flexible Working: Hybrid model, with 2-3 days in the office
Additional Questions or Interest?