Databricks Data Engineer — AI-Driven Lakehouse Specialist
Posted Updated
Description
Deloitte NZ is seeking an experienced Databricks Data Engineer in Auckland to design, build, and maintain scalable data and AI solutions. You will work across ingestion, transformation, modelling, and production support, leveraging Lakehouse architectures and AI-enabled tooling.
Join a team delivering data platforms at enterprise scale, collaborating with data scientists, engineers, and stakeholders to accelerate data-driven outcomes with security and governance at the forefront.
Design, develop, and maintain scalable data and AI solutions on Databricks. Build robust data ingestion, ELT/ETL, and data processing pipelines. Develop reusable transformations via Lakeflow Declarative Pipelines. Design Lakehouse architectures and curated data models for analytics and ML. Integrate Databricks with cloud platforms, APIs, databases, and streaming systems. Implement CI/CD pipelines and modern DevOps practices for Databricks deployments. Orchestrate workloads with Lakeflow Jobs, Azure Data Factory, Airflow, or similar tools. Ensure security, governance, data quality, lineage, and monitoring controls. Strong hands-on experience with Databricks and Lakehouse architectures. Solid understanding of data modelling, warehousing, and distributed processing. Experience designing batch and/or streaming data pipelines. Familiarity with orchestration tools such as Lakeflow Jobs, Azure Data Factory, and Airflow. Knowledge of cloud data services on Azure and/or AWS; Git, CI/CD modern practices. Flexible work arrangements Subsidised professional qualifications Subsidised health insurance Income protection insurance 22 days annual leave Social events & wellness focus Sustainability focusSkills
Sign in to read and join the discussion.