Data Engineer: Spark & SQL on Azure Databricks
Summary
CareCone Group is hiring a hands-on Data Engineer in Sydney to design, build, and optimize high-throughput data pipelines on Azure Databricks. Day to day the role covers ETL/ELT development, Delta Lake best practices, real-time integrations, and CI/CD/observability, using Spark (Scala), SQL, Python, Databricks, and Kafka.
CareCone Group in Sydney is seeking a hands-on Developer to design, build, and optimize high-throughput data pipelines on Azure Databricks using Spark (Scala) and SQL. The role focuses on ETL/ELT architectures, Delta Lake best practices, and real-time integrations.
You will implement CI/CD, secrets management, and observability while working with modern data platforms. Key skills include Scala Spark, SQL, and Python, plus familiarity with Databricks and Kafka.