Senior Data Engineer
Summary
Designs and maintains data pipelines to transform raw data into insights using Python/Java/Scala, SQL/NoSQL, and ETL tools.
Overview
We are seeking an experienced professional to join our team as a data engineering specialist. In this position, you will play a critical role in designing, building, and maintaining our data infrastructure.
Responsibilities
- Develop and optimise data pipelines that transform raw data into actionable insights.
- Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions.
- Ensure data integrity and reliability through thorough testing, monitoring, and troubleshooting of data systems.
- Implement best practices for data governance and security.
- Stay updated with the latest industry trends and technologies to enhance our data capabilities.
Requirements
- Proven experience as a Data Engineer or in a similar role.
- Strong proficiency in programming languages such as Python, Java, or Scala.
- Experience with database technologies including SQL and NoSQL.
- Familiarity with data warehousing solutions and ETL processes.
- Excellent problem-solving skills and the ability to work independently.
Nice to have
- Experience with cloud platforms such as AWS, Azure, or Google Cloud.
- Knowledge of big data technologies like Hadoop or Spark.
- Experience with data visualisation tools.
- Strong communication skills and teamwork abilities.