Data Engineer: PySpark, Databricks & Delta Lake
Description
APAR TECHNOLOGIES PTE. LTD. in Singapore is seeking a data engineer to design and maintain scalable data pipelines. You will use PySpark with Databricks to process data, implement Delta Lake with SQL transformations, and optimize performance for reliability.
The role involves integrating data from APIs, databases and files, enforcing data quality checks, and collaborating with analysts and business teams to meet data requirements.