Google Data & AI Engineer (GCP)
Summary
Builds and runs a Google Cloud data platform end to end for a major Australian enterprise: batch and streaming pipelines with Dataflow, Composer and Pub/Sub landing in BigQuery, plus the underlying Terraform, networking and security, owning it all in production via monitoring and CI/CD.
Most data engineers stop at the pipeline. This role wants someone who also builds the platform underneath it.
The opportunity
This is a permanent role with a major Australian enterprise. You\'ll build and run their Google Cloud data platform end to end, from ingestion to the infrastructure it sits on.
What you\'ll be doing
- Building batch and streaming pipelines with Dataflow, Composer and Pub/Sub, landing in BigQuery
- Shaping BigQuery models so queries run fast and costs stay sensible
- Building the data foundations that machine learning and AI models are trained and run on
- Writing the Terraform, networking and security that keep the platform sound
- Owning pipelines in production: monitoring, fixing, and automating releases through CI/CD
- Working alongside data scientists, analysts and engineers to deliver what they need
- Keeping an eye on new GCP services worth bringing in
What you\'ll bring
- Advanced Terraform and enterprise-grade GCP cloud engineering
- Confidence with VPCs, subnets, load balancing, firewalls and DNS
- Python or Bash, plus Git, Docker and Kubernetes
- DataOps habits: automated testing and data quality built in from the start
The package
- $140K to $180K base, plus super and bonus
- Hybrid, with three days a week on site
- Australian work rights required; background checks apply
If you\'ve built both the pipelines and the platform, I\'d love to hear from you.