Streaming Data Engineer (Databricks & Python)
Summary
Design and maintain real-time data processing pipelines using Databricks, Apache Spark Structured Streaming, and Python, troubleshooting streaming jobs and collaborating with engineers and stakeholders to deliver scalable, reliable workflows. Suited for a data engineer with 5-10 years of experience and a distributed computing background.
PERSOL Singapore Pte Ltd is seeking an experienced data engineer to develop and maintain data processing solutions using Databricks and Python in a fast-paced environment. You will design real-time pipelines with Apache Spark Structured Streaming, troubleshoot streaming jobs, and collaborate with data engineers and stakeholders to deliver scalable, reliable workflows.
The ideal candidate brings 5–10 years of data engineering experience, a solid foundation in distributed computing, and a