GCP Data Engineer
Posted Updated 16
views
Summary
Permanent GCP Data Engineer role in Sydney: build and maintain cloud-native ETL/ELT pipelines using Python, BigQuery, Cloud Composer (Airflow), Pub/Sub, Cloud Storage and Terraform, with data warehousing, migration, and data governance work. Nice-to-haves include Databricks, ServiceNow/Salesforce integrations and JIRA.
Role : GCP Data Engineer
Type of role - Permanent Position
Location : Sydney, Australia
Job Description
- Strong expertise in Python and API Integration (REST APIs, JSON/XML, OAuth, error handling, and data ingestion frameworks).
- Hands on experience with GCP services including BigQuery, Dataform, Cloud Composer (Airflow), DAG development, Secure Source Manager, Cloud Storage and Pub/Sub.
- Proven experience designing and implementing scalable ETL/ELT pipelines and cloud native data solutions.
- Strong understanding of Data Warehousing, dimensional modelling, and data lifecycle management.
- Experience delivering large scale Data Migration projects with data validation and reconciliation.
- Hands on experience with Cloud DLP, data governance, security, and compliance requirements.
- Advanced SQL skills, including performance tuning and complex data transformations.
- Experience using Terraform for Infrastructure as Code (IaC) and GCP resource deployment.
- Familiarity with CI/CD pipelines, Agile delivery practices, and enterprise integration patterns.
- Good to Have: Databricks, Data Quality, ServiceNow/Salesforce integrations and JIRA.
Skills
Sign in to read and join the discussion.