Data Engineer — Real-Time Pipelines & Azure Platform
Posted Updated
Description
NCS Pte Ltd in Singapore is seeking a Data Engineer to develop and maintain scalable data pipelines, integrate multiple data sources, and ensure high-quality data processing for analytics, reporting, and machine learning tasks.
You will collaborate with analytics, product and infrastructure leaders to advance the company’s data platform, implement governance, monitoring and reliability standards, and apply modern data tooling on Azure Databricks and related platforms.
Develop and maintain ETL pipelines for centralized data storage systems. Integrate data from databases, APIs, log files, streaming platforms, and external providers. Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex or inconsistent datasets. Contribute to frameworks and best practices for code development and deployment. Implement data governance in alignment with company standards. Partner with analytics and product leaders to design and operationalize pipelines. Collaborate with infrastructure leaders to advance cloud-based data platforms. Explore new tools and techniques leveraging Azure, Databricks, or related platforms. Monitor data pipelines to detect and resolve issues promptly. Develop monitoring tools, alerts, and automated error-handling mechanisms. Open to wide range of data engineering experience levels including fresh graduates. Hands-on with data processing jobs using Talend, PySpark and SQL. Experience orchestrating data pipelines with Talend, ADF, Airflow, or similar tools. Experience with both batch and real-time data processing. Proficiency in SQL with exposure to multiple data systems like SQL DB, Cloudera. Understanding of DevOps tools, Git workflows, CI/CD or MLOps pipelines.Skills
Sign in to read and join the discussion.