freehire launches on Product Hunt on 26 August.

Follow →

Data Engineer

Summary

Designs and operates large-scale data pipelines to process real-time maritime streaming data, ensuring reliability and performance for global trade intelligence platforms.

At Kpler, we are dedicated to helping our clients navigate complex markets with ease. By simplifying global trade information and providing valuable insights, we empower organisations to make informed decisions in commodities, energy, and maritime sectors. Since our founding in 2014, we have focused on delivering top-tier intelligence through user-friendly platforms. Our team of over 700 experts from 35+ countries works tirelessly to transform intricate data into actionable strategies, ensuring our clients stay ahead in a dynamic market landscape. Join us to leverage cutting-edge innovation for impactful results and experience unparalleled support on your journey to success. Your future position: We are looking for a Data Engineer to join our Maritime Ingress team, where you’ll build systems that power global maritime intelligence by processing massive volumes of real-time streaming data and delivering mission-critical insights used worldwide. In this role, you will design and operate large-scale distributed systems that ingest and process continuously flowing data from diverse external sources and formats. You will tackle complex global data ingestion challenges while ensuring accuracy, reliability, and performance in platforms that support trusted, real-time maritime intelligence. If you enjoy solving complex data challenges, building resilient large-scale systems, and working with real-time streaming architectures in a high-growth environment, this is an opportunity to make a meaningful global impact. Your work will directly contribute to delivering accurate and reliable maritime intelligence used by customers worldwide. Your mission is to: Build and operate scalable batch and streaming data pipelines (e.g., Kafka, Spark), ensuring reliable ingestion, processing, and recovery in production environments. Design and implement data quality and governance mechanisms including validation, lineage, and m

See also