GCP Data Engineer
Posted 37
views
Summary
GCP Data Engineer based in Sydney building and maintaining scalable ETL/ELT pipelines and cloud-native data solutions on Google Cloud (BigQuery, Dataform, Cloud Composer/Airflow, Pub/Sub), with advanced SQL, Python/API integration, and Terraform-based infrastructure work.
Location: Sydney
Job Description
- Hands on experience with GCP services including BigQuery, Dataform, Cloud Composer (Airflow), DAG development, Secure Source Manager, Cloud Storage and Pub/Sub.
- Proven experience designing and implementing scalable ETL/ELT pipelines and cloud native data solutions.
- Strong understanding of Data Warehousing, dimensional modelling, and data lifecycle management.
- Experience delivering large scale Data Migration projects with data validation and reconciliation.
- Hands on experience with Cloud DLP, data governance, security, and compliance requirements.
- Advanced SQL skills, including performance tuning and complex data transformations.
- Experience using Terraform for Infrastructure as Code (IaC) and GCP resource deployment.
- Familiarity with CI/CD pipelines, Agile delivery practices, and enterprise integration patterns.
- Strong expertise in Python and API Integration (REST APIs, JSON/XML, OAuth, error handling, and data ingestion frameworks).
- Good to Have: Databricks, Data Quality, ServiceNow/Salesforce integrations and JIRA.
Skills
Sign in to read and join the discussion.