Data Engineer: Real-Time Pipelines on Azure & Databricks
Summary
Designs and maintains scalable real-time data pipelines on Azure and Databricks, integrating sources and enabling analytics and ML workloads.
NCS Pte Ltd is seeking a Data Engineer to design, develop, and maintain scalable data pipelines on Databricks and cloud platforms, enabling analytics, reporting, and ML workloads. You will collaborate with analytics, product, and infrastructure teams to ensure governance, monitoring, and reliability across the data platform.
Responsibilities include building ETL/ELT pipelines, integrating diverse data sources, implementing data quality checks, and driving CI/CD for data workloads while exploring