Data Engineer - Senior Analyst
Posted Updated
Description
Opus Recruitment Solutions Limited in the United Kingdom is seeking a data engineer to build and optimise data pipelines using Java (preferred) or Python, develop real-time streaming and batch workflows, and collaborate with analytics, AI/ML, product and engineering teams.
This role involves working with Kafka, Flink or Spark, AWS Kinesis/MSK/Lambda/Glue, governance and security controls, and deploying containerised workloads with Docker, Kubernetes and AWS EKS; experience with Terraform and
Build and optimise data pipelines using Java (preferred) or Python. Develop real-time streaming and batch data pipelines. Work with Kafka, Flink or Spark, with Kafka/Flink preferred. Develop AWS-based data solutions using Kinesis, MSK, Lambda and Glue. Implement data governance, lineage, security and quality controls. Support CI/CD using Azure DevOps, GitHub Actions or Jenkins. Use Terraform and Infrastructure as Code practices. Deploy containerised workloads using Docker, Kubernetes and AWS EKS. Build and optimise data pipelines using Java (preferred) or Python. Develop real-time streaming and batch data pipelines. Work with Kafka, Flink or Spark, with Kafka/Flink preferred. Develop AWS-based data solutions using Kinesis, MSK, Lambda and Glue. Implement data governance, lineage, security and quality controls. Support CI/CD using Azure DevOps, GitHub Actions or Jenkins. Use Terraform and Infrastructure as Code practices. Deploy containerised workloads using Docker, Kubernetes and AWS EKS.Skills
Sign in to read and join the discussion.