Data Engineer - Spark, Delta Lake & Real-Time Pipelines
Posted 2
views
Summary
Senior Data Engineer in Singapore designing scalable data pipelines on Databricks Lakeflow and Delta Lake using Bronze/Silver/Gold medallion architecture. Day to day involves real-time ingestion, performance tuning, governance via Unity Catalog and ACLs, and code review, with Python and Spark as the core stack.
ECLATPRIME DIGITAL PTE. LTD. in Singapore seeks a senior Data Engineer to design and build scalable data pipelines with Lakeflow and Delta Lake, leveraging Bronze/Silver/Gold medallions.
You will optimize performance, enforce governance using Unity Catalog and ACLs, review code, and implement real-time or near-real-time ingestion. Strong Python and Spark experience plus Databricks certification are highly valued.