Senior Data Engineer – Databricks / AWS
Summary
Otic Group is hiring a Senior Data Engineer in Melbourne to design, build, and deploy enterprise data platforms and pipelines on AWS using Databricks, PySpark, dbt, and Terraform, with CI/CD via GitHub Actions. Applicants must be Melbourne-based with Australian citizenship, PR, or permanent work rights.
“Otic” means smart people doing smart work, together.
We are a wholly owned Australian company committed to helping our clients design and build intelligent software solutions that unlock value in their business.
Otic Group was formed to provide talented technology professionals an opportunity to work with not only some of the most prominent companies in Australia, but work with incredibly talented peers in an exciting, dynamic young environment.
We are seeking a Senior Data Engineer with strong hands-on experience designing, building and deploying enterprise data platforms and pipelines within cloud environments.
Key Skills And Experience Required
- Strong commercial experience with Databricks, including development of scalable data architectures and data pipelines.
- Advanced Python and PySpark development skills.
- Strong AWS cloud experience supporting data engineering solutions.
- Experience building and maintaining ETL/data pipelines using technologies such as Apache Spark and dbt.
- Strong Terraform / Infrastructure as Code experience, ideally provisioning and managing Databricks environments.
- Experience implementing automated CI/CD pipelines, preferably using GitHub Actions or similar tooling.
- Strong understanding of modern data lake, data warehouse and cloud data architecture patterns.
- Experience processing and transforming large-scale datasets.
- Strong software engineering practices including Git, testing, deployment automation and code quality.
- Ability to translate business and technical requirements into practical, scalable data solutions.
- Strong stakeholder communication skills and the ability to operate independently in a complex enterprise environment.
- Ideally 7+ years of data engineering experience with recent hands-on delivery in large enterprise environments.
Over and above having these technical skills, you will also have a strong passion and flair for creating professional prototypes and dashboards.
Being a Melbourne based organisation, we’re looking for our team to be based locally. We also require applicants to hold an Australian Citizenship, Permanent Residency (PR), or have other permanent work rights.