Senior Data Engineer — Spark, Cloud Pipelines & Real-Time
Summary
REGTECH INSIGHT PTE. LTD. in Singapore is hiring a Senior Data Engineer to design, build, and optimize scalable batch and real-time data pipelines using Spark, PySpark, Scala, and Python across Azure Databricks, ADF, and AWS EMR, plus Hadoop, Snowflake, data lakes, SQL data modeling, Airflow workflows, and CI/CD.
REGTECH INSIGHT PTE. LTD. is seeking an experienced Data Engineer to design, build and optimize scalable data pipelines for large datasets. You will develop batch and real-time processing using Spark, PySpark, Scala and Python, and leverage Azure Databricks, ADF and AWS EMR across diverse data platforms.
You will work with Hadoop ecosystems, Snowflake and data lake environments, crafting efficient SQL queries and robust data models while implementing Airflow-driven workflows and CI/CD practices.