Data Engineer: Databricks, PySpark & Delta Lake
Posted Updated
Description
Espire Infolabs is seeking a hands-on Data Engineer in Singapore to design, build, and optimize scalable data pipelines on the Databricks Lakehouse platform. You will collaborate with analysts, data scientists, and business teams to turn raw data into analytics-ready assets.
The role requires 3–5 years of hands-on data engineering experience, strong PySpark and SQL skills, and experience with Databricks and Delta Lake on cloud platforms (Azure/AWS/GCP).
Design, build, and optimize scalable data pipelines on the Databricks Lakehouse platform. Collaborate with analysts, data scientists, and business teams to turn raw data into analytics-ready assets. 3-5 years of hands-on data engineering experience. Strong PySpark skills (DataFrames, Spark SQL, UDFs, performance tuning). Proven experience building production pipelines on Databricks. Solid working knowledge of Delta Lake (ACID, time travel, merge/upsert, schema evolution). Advanced SQL and strong Python. Experience with a major cloud platform (Azure, AWS, or GCP) and its storage and data services. Understanding of data modelling (dimensional, lakehouse) and ETL/ELT patterns. Familiarity with Git and CI/CD practices.Skills
Sign in to read and join the discussion.