Senior Data Engineer: Real-Time Pipelines & Lakehouse
Agensi Pekerjaan Penta Consultancy Sdn. Bhd Senior Data Engineer: Real-Time Pipelines & Lakehouse
Summary
Senior Data Engineer based in Kuala Lumpur who designs, builds, and maintains scalable real-time data pipelines and lakehouse infrastructure on Databricks, PySpark, and Delta Lake in the cloud. Day-to-day work covers ETL/ELT development, data governance with Unity Catalog and RBAC/ABAC, Delta Sharing, and CI/CD via GitHub Actions.
Agensi Pekerjaan Penta Consultancy Sdn. Bhd is seeking an experienced Data Engineer to design, develop, and maintain scalable data pipelines using Databricks, PySpark and Delta Lake in a cloud environment.
You will build ETL/ELT processes, manage data governance, and optimize performance across warehouses and lakehouses. The role requires deep experience with Unity Catalog, RBAC/ABAC, Delta Sharing, and CI/CD via GitHub Actions.