Data Engineer (Databricks)
Posted Updated
Description
Elliott Moss Consulting Pte. Ltd. is seeking an experienced Databricks Architect / Lead Data Engineer to design, develop, and deliver enterprise-scale data platforms on Databricks and AWS.
The role combines architecture leadership with hands-on engineering responsibilities across modern data pipelines, AI/ML workloads, and governance. Responsibilities include leading Databricks initiatives, mentoring engineers, building scalable pipelines, and optimizing Spark workloads while driving CI/CD,
Design and own Databricks Lakehouse architecture on AWS and guide engineers. Build and optimize batch and streaming data pipelines using PySpark and SQL. Implement Medallion architecture (Bronze/Silver/Gold) across enterprise datasets. Enable AI/ML workloads on Databricks and integrate with AWS services. Extensive experience designing Databricks Lakehouse architectures on AWS. Proven ability to lead data engineering teams and deliver scalable pipelines. Strong knowledge of governance, Unity Catalog, and security controls.Skills
Sign in to read and join the discussion.