Senior Data Engineer - Real-Time Pipelines & Spark
Summary
Design, build, and optimize scalable batch and real-time data pipelines for large enterprise datasets using Spark/PySpark (incl. Structured Streaming), Python/Scala, Kafka, and cloud services, with a focus on data quality, security, and cost efficiency.
UARROW PTE. LTD. is seeking an experienced Data Engineer to design, build and optimize scalable data pipelines for large datasets. You will work across Spark/PySpark, Python/Scala, and cloud services to deliver reliable ingestion, transformation and warehousing capabilities.
You will deploy batch and real-time processing using Spark Structured Streaming and Kafka, collaborate with cross‑functional teams, and ensure data quality, security and cost efficiency in a fast-paced enterprise environment.