Senior Data Engineer | Contract | Hybrid Working Arrangement
Posted Updated 3
views
Description
NEXBRIDGE RECRUITMENT PTE. LTD. is seeking an experienced Data Engineer to lead design and implementation of scalable batch and streaming data pipelines on AWS and Databricks. You will develop Bronze-Silver-Gold data layers, enforce data contracts, and drive data governance across interconnected teams.
The role requires hands-on expertise with Databricks, Spark, Delta Lake and cloud data services, plus strong coding in Python and SQL to deliver reliable data products and dashboards.
Lead design and implementation of batch and streaming pipelines ingesting diverse data Design Bronze, Silver and Gold data layers using Delta Lake Implement ingestion from databases, files, APIs and event streams Establish data quality checks, contracts, lineage and metadata management Build parameterised workflows using Databricks Workflows or Lakeflow Define observability dashboards, alerts and runbooks for pipeline health and data quality Optimize Spark/SQL workloads and cost efficiency on AWS/Databricks Apply security controls and least-privilege access for data sharing Mentor engineers and promote reusable data components Collaborate with data owners, governance and platform teams to translate needs into specs 6 years of relevant data or software engineering experience with production data pipelines Hands-on design and operation of cloud-based data platforms (e.g. AWS) Strong Python, PySpark and SQL capabilities including distributed processing and automated testing Experience with Databricks, Apache Spark and Delta Lake in production Experience with data lake architectures, data contracts and data governanceSkills
Sign in to read and join the discussion.