Data Engineer: PySpark, Databricks & Delta Lake
Posted 2
views
Summary
A data engineer in Singapore who designs and maintains scalable data pipelines, processing data with PySpark on Databricks and implementing Delta Lake SQL transformations. Day to day involves integrating data from APIs, databases, and files, enforcing data quality checks, and optimizing pipeline performance.
APAR TECHNOLOGIES PTE. LTD. in Singapore is seeking a data engineer to design and maintain scalable data pipelines. You will use PySpark with Databricks to process data, implement Delta Lake with SQL transformations, and optimize performance for reliability.
The role involves integrating data from APIs, databases and files, enforcing data quality checks, and collaborating with analysts and business teams to meet data requirements.