Data Engineer - Basil Technologies Pte Ltd
Summary
Data engineer who builds and maintains ETL pipelines into centralized storage (Delta Lake) on Databricks, integrating data from databases, APIs, log files, streaming platforms, and external providers, plus writing transformation routines and implementing data governance. Databricks certification is mandatory.
- Databricks Certification is Mandatory
- Develop and maintain ETL pipelines for centralized data storage systems (e.g. Delta Lake).
- Integrate data from databases, APIs, log files, streaming platforms, and external providers
- Develop data transformation routines to clean, normalize, and aggregate data
- Apply data processing techniques to handle complex or inconsistent datasets
- Contribute to frameworks and best practices for code development and deployment
- Implement data governance in al…