Databricks Data Engineer: Azure Pipelines & Real-Time Analytics
Summary
The Data Engineer will design, develop, and maintain scalable data pipelines using Databricks and cloud platforms to support analytics and machine learning. The role focuses on implementing ETL processes, streaming and batch data integration, and ensuring data quality and reliability.
Basil Technologies Pte. Ltd. in Singapore is seeking a Data Engineer to design, develop, and maintain scalable data pipelines on Databricks and cloud platforms.
You will integrate diverse data sources to support analytics, reporting, and machine learning, while collaborating with cross-functional teams on governance, monitoring, and reliability. The role involves implementing ETL pipelines, data transformation routines, and data quality controls, with emphasis on streaming and batch processing,