Azure Databricks Data Engineer for Real-Time ETL & Streaming
Summary
CareCone Group is hiring a hands-on data engineer in Sydney to design and optimize high-throughput real-time ETL/ELT pipelines on Azure Databricks using Spark (Scala) and SQL. The work follows medallion architecture and Delta Lake best practices, with scheduling, Git-based CI/CD, secrets management, and observability.
CareCone Group is seeking a hands-on Developer Programmer to design and optimize high-throughput data pipelines on Azure Databricks using Spark (Scala) and SQL. The role focuses on scalable ETL/ELT development following medallion architecture (Bronze/Silver/Gold) and Delta Lake best practices.
The ideal candidate will implement real-time and near real-time integrations, operationalize workloads with scheduling, CI/CD using Git, secrets management, and strong observability across cloud data