Data Engineer - Senior Analyst
Posted 79
views
Summary
Senior data engineer role based in Newcastle upon Tyne, sourced through recruiter Opus Recruitment Solutions. The person builds and optimises real-time streaming and batch data pipelines using Java (preferred) or Python, Kafka/Flink/Spark, AWS services (Kinesis, MSK, Lambda, Glue), Terraform IaC, Docker/Kubernetes on EKS, and CI/CD tooling.
Build and optimise data pipelines using Java (preferred) or Python. Develop real-time streaming and batch data pipelines. Work with Kafka, Flink or Spark, with Kafka/Flink preferred. Develop AWS-based data solutions using Kinesis, MSK, Lambda and Glue. Implement data governance, lineage, security and quality controls. Support CI/CD using Azure DevOps, GitHub Actions or Jenkins. Use Terraform and Infrastructure as Code practices. Deploy containerised workloads using Docker, Kubernetes and AWS EK…
Skills
Sign in to read and join the discussion.