Senior Cloud Data Platform Engineer
Summary
Senior engineer owning cloud infrastructure and real-time data streaming for a high-concurrency live-betting gaming platform on AWS. Day to day: building Kafka/CDC event-driven pipelines, Terraform IaC, Kubernetes deployments, data lake architecture, zero-downtime routing, observability and FinOps.
Own the cloud infrastructure, real-time data streaming and scaling of a high-concurrency gaming platform serving millions of active players. This sits at the intersection of cloud engineering and big data: low-latency distributed pipelines, resilient event-driven architecture, and zero-downtime routing layers that carry heavy transactional throughput for a money-moving system under live-betting traffic spikes.
Responsibilities
- Design, deploy and maintain scalable cloud environments using infrastructure as code (Terraform)
- Build and operate real-time, event-driven data pipelines built for scale, fault tolerance and sub-second latency
- Architect and optimise storage backends and data lake infrastructure for both live transactional routing and analytical workloads
- Implement high-availability networking, API gateways, automated failover and zero-downtime routing strategies
- Integrate data validation, observability and monitoring into the pipeline lifecycle to catch bottlenecks and data drift before they reach production
- Drive long-term cloud scaling, FinOps (cost optimisation), disaster recovery and system benchmarking
Requirements
- 5+ years in cloud infrastructure, data engineering or distributed systems architecture
- Deep experience building distributed data pipelines with event-driven architectures (Apache Kafka) and Change Data Capture (CDC)
- Cloud platform depth — AWS primary (GCP a plus): networking, API gateways, high availability, automated failover, zero-downtime routing
- Expert infrastructure provisioning with Terraform
- Containerisation and orchestration — Docker, Kubernetes
- Solid understanding of object storage (S3), distributed data lakes and lakehouse design
- Fluent written and spoken English