Data Platform Engineer
Summary
The Data Platform Engineer will design, build, and maintain scalable data infrastructure for a banking client, focusing on real-time streaming and cloud services. The role requires expertise in Kafka, Amazon MSK, Kinesis, Kubernetes, and Terraform to ensure platform reliability and performance.
We have one open position of Senior Data Platform Engineer with one of our client based in Milton Keynes, UK. This is a permanent/fulltime position. Below is the full job description for your reference. Please share your application once you are interested
Role: Data Platform Engineer with Banking Domain
Location: Milton Keynes, UK - Hybrid
Work Mode: 12 Months Fix Term Employment & Permanent
Role Overview
We are looking for an experienced Data Platform Engineer with strong expertise in infrastructure, cloud platforms, containerization and real-time data streaming. The ideal candidate should have hands-on experience building, deploying and supporting scalable data platforms using Kafka, Kubernetes, Terraform, Amazon MSK and Amazon Kinesis.
Key Responsibilities
- Design, build and maintain scalable data platform infrastructure across cloud environments.
- Manage and support Apache Kafka / Amazon MSK clusters, including configuration, monitoring, scaling and performance optimization.
- Work extensively with Amazon Kinesis and real-time data streaming platforms.
- Deploy and manage data platform components using Kubernetes.
- Develop and maintain infrastructure using Terraform / Infrastructure as Code (IaC).
- Manage platform reliability, availability, scalability and performance.
- Implement monitoring, alerting, logging and troubleshooting for streaming and infrastructure components.
- Work with DevOps, Data Engineering and Cloud teams to build reliable data-platform solutions.
- Troubleshoot issues related to Kafka brokers, topics, partitions, replication, consumer groups and streaming pipelines.
- Implement security, access control and best practices across cloud and data-platform infrastructure.
- Automate platform provisioning, deployment and operational processes.
Mandatory Skills
- Hands-on experience with Apache Kafka.
- Strong experience with Amazon MSK (Managed Streaming for Apache Kafka).
- Good experience with Amazon Kinesis / Kinesis Data Streams.
- Strong Terraform / Infrastructure as Code experience.
- Good understanding of AWS infrastructure and cloud services.
- Experience with real-time data streaming and distributed systems.
- Strong knowledge of monitoring, troubleshooting and performance optimisation.
- Experience working in production-scale environments.
Good to Have
- AWS certifications.
- Experience with Docker and CI/CD.
- Experience with Prometheus, Grafana, CloudWatch or similar monitoring tools.
- Experience with Helm and Kubernetes operators.
- Experience with Python, Java or Shell scripting.
- Knowledge of networking, security, IAM and Linux administration.
- Experience with data lake/data platform architecture.