Senior Data Engineer
Summary
Lead large-scale data migrations and build scalable cloud pipelines using Scala, Spark, and Kubernetes to transform enterprise data systems.
Company and Job Description
Join a leading technology-focused consulting environment that partners with innovative businesses across multiple industries to deliver impactful digital and data solutions. This role offers the chance to work on sophisticated data engineering programmes involving large-scale migrations, data transformation, privacy initiatives, and cloud-based platforms. As a Senior Data Engineering Technical Lead, you will combine hands-on engineering expertise with technical leadership, driving the successful delivery of complex projects while mentoring and developing engineering talent. You will work alongside high-performing teams in a collaborative environment that encourages innovation, continuous improvement, and technical excellence.Key Responsibilities:
- Lead the design and implementation of large-scale data migration and transformation initiatives
- Develop and maintain scalable data processing pipelines across cloud and distributed environments
- Drive technical design decisions and provide ownership of critical platform components
- Establish testing, validation, and quality assurance frameworks for complex data solutions
- Implement monitoring and observability practices to ensure reliability and performance
- Mentor engineers through code reviews, technical coaching, and collaborative development practices
- Partner with cross-functional stakeholders to ensure successful project delivery
Job Experience and Skills Required:
- Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field
- Minimum 8 years of experience within Data Engineering, Software Engineering, or similar technical roles
- Proven experience leading technical teams and delivering large-scale data projects
- Strong background in data migration, ETL development, and distributed data processing
- Experience working within enterprise-scale environments
- Advanced proficiency in Scala and Java
- Strong experience with Apache Spark and distributed data technologies
- Hands-on experience working with cloud platforms such as AWS, Azure, GCP, or Databricks
- Experience with Kubernetes and containerised environments
- Strong understanding of distributed systems architecture
- Knowledge of data privacy, security, and governance best practices
- Experience with data storage technologies and modern data formats
- Excellent troubleshooting and problem-solving capabilities
- Exposure to streaming technologies is advantageous
- Experience with observability, monitoring, and performance optimisation tools beneficial
- Strong leadership, mentoring, and stakeholder engagement skills
- Ability to thrive in collaborative, high-performing team environments
- Passion for continuous learning, innovation, and engineering excellence
Apply now!
For more exciting IT vacancies, please visit: