Azure Databricks Data Engineer: Real-Time ETL Pipelines
Posted 1
view
Summary
A data engineer role in Sydney designing, building, and optimizing high-throughput real-time ETL/ELT pipelines on Azure Databricks with Spark (Scala) and SQL, including performance tuning and CI/CD-driven operationalization.
CareCone Group seeks a hands-on Developer Programmer to design, build, and optimize high-throughput data pipelines on Azure Databricks using Spark (Scala) and SQL. You will design scalable ETL/ELT processes, implement real-time data integrations, and operationalize workloads with CI/CD and observability.
Proficiency in Delta Lake and medallion data architecture is a plus. The role emphasizes end-to-end pipeline design, performance tuning, and collaboration with data stakeholders.