Data Engineer-GCP
Summary
Build and maintain scalable data pipelines on GCP using BigQuery, Dataflow, and Pub/Sub, with Python and SQL.
XPT Software Australia Pty Ltd | Contract
Sydney, Australia | Posted on 07/21/2026
Job Description
Must Have Skills
- Strong GCP Data Services Expertise - Hands‑on experience with BigQuery, Dataflow, Pub/Sub, Cloud Storage, Ability to design scalable data solutions using native GCP tools.
- Experience in Data Pipeline Development (Batch & Streaming) - Building and maintaining ETL/ELT pipelines, Experience with real-timestreaming and batch processing.
- Strong Programming & Query Skills - Proficiency in Python and SQL, Experience with data processing frameworks like ApacheBeam or Spark.
- Understanding of Data Modeling & Warehousing - Strong understanding of data modeling (star/snowflake schemas), Experience designing and optimizing data warehouses (BigQuery).
Nice to Have Skills
- Experience in Multi-Cloud Exposure : Understanding of cross-cloud data integration and migration, Experience working with AWS or Azure alongside GCP.
- Knowledge of Streaming & Messaging Frameworks : Experience with Kafka or advanced Pub/Sub patterns, Knowledge of real-time data architectures.
- Basic Understanding of Containerization & Orchestration : Hands‑on with Docker and Kubernetes (GKE), Ability to deploy and manage data workloads in containerized environments.
- Data Governance & Security : Familiarity with data lineage, cataloging, and governance tools, Understanding of IAM roles, data security, and compliance in GCP.