Senior Data Engineer - Azure Databricks & Data Platform
Summary
Build and maintain ETL/ELT pipelines using Azure Data Factory, Databricks, and Delta Lake, implementing PySpark and SQL processing for analytics and ML workloads.
E-Outsource Asia is seeking a Senior Data Engineer in Kuala Lumpur to design, build and maintain ETL/ELT pipelines using Azure Data Factory, Databricks and Delta Lake. You will implement PySpark and SQL processing, ingest data into ADLS Gen2, and create curated datasets for analytics and ML with strong data governance.
You will drive CI/CD for data jobs, optimize costs, monitor pipelines, and collaborate with cross-functional teams to meet SLAs/SLOs, while contributing to platform standards and