Big Data Engineer (Senior)

Our client is seeking a Senior Big Data Engineer to build and optimise large-scale data platforms that support advanced analytics, machine learning, and enterprise data products. This is an exciting opportunity to work on high-volume data processing solutions within a cloud-first environment while collaborating with multidisciplinary engineering teams.

Key Responsibilities

• Design, develop, and maintain high-volume data ingestion and transformation pipelines.
• Build scalable feature stores, analytical datasets, and data processing frameworks.
• Optimise data workflows for performance, scalability, and reliability.
• Develop ETL/ELT solutions supporting enterprise data products.
• Collaborate with architects, data scientists, and platform engineers.
• Implement data quality, validation, and governance processes.
• Support cloud-native data engineering initiatives and platform optimisation.
• Produce technical documentation and support operational excellence.

Requirements

• Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field.
• 10+ years' experience in data engineering or big data development.
• Strong experience with Spark, Hadoop, or similar distributed data processing technologies.
• Strong SQL and programming skills (Python, Scala, or Java).
• Experience working with cloud-based data platforms.
• Excellent analytical and problem-solving skills.

Advantageous

• Experience with Azure Databricks or comparable cloud data platforms.
• Experience with Kafka or streaming technologies.
• Cloud certifications.
• Telecommunications, financial services, or enterprise analytics experience.

Personal Attributes

• Detail-oriented with a passion for data engineering.
• Strong collaboration and communication skills.
• Self-driven and adaptable.Able to manage multiple priorities effectively.
• Committed to delivering high-quality, scalable data solutions.