platform engineer for high-throughput data platforms
Summary
Build and run a high-throughput event-streaming platform (Kafka/Redpanda) and CDC pipelines to move trading data with low latency, using Terraform, ArgoCD, and Kubernetes.
Описание
The company is a growing trading firm where speed is the product. Its systems depend on fast and reliable data movement, from trade execution to the tools traders use during market hours.
Задачи
- Design and operate an event-streaming platform using Kafka or Redpanda as the backbone for data movement across the business;
- Build change-data-capture pipelines with tools such as Debezium to extract data from existing systems, including latency-sensitive trading systems, without disrupting them;
- Design a tiered delivery model to optimise paths that require lower latency while keeping most flows at millisecond-scale;
- Run the platform with infrastructure-as-code and GitOps using Terraform, ArgoCD, and Kubernetes;
- Make architecture decisions for a new data platform and build its reference architecture.
Требования
- Production experience with Kafka or Redpanda at meaningful scale;
- Experience reasoning about latency, throughput, and reliability trade-offs in real-time or high-volume environments;
- Experience with change-data-capture tooling and streaming or ETL patterns;
- Experience with infrastructure-as-code and GitOps using Terraform, ArgoCD, and Kubernetes.
Условия
€ 110.000,- + Bonus.