Data Engineer with GCP
Summary
Data engineer designing, building, and maintaining scalable data pipelines and ETL/ELT workflows on Google Cloud, using BigQuery, Python, PySpark, Apache Beam, Cloud Dataflow, Cloud Composer, and Pub/Sub, including data lakes and data warehouses. On-site role in Ryde, Australia.
Key Responsibilities
Design, develop, and maintain scalable data pipelines using GCP services. Build and optimise ETL/ELT workflows for batch and real-time data processing. Work with Google BigQuery for data warehousing, SQL development, and query optimisation. Develop data processing solutions using Python, PySpark, and Apache Beam. Implement data integration using Cloud Dataflow, Cloud Composer, and Pub/Sub. Build and manage data lakes and data warehouses on Google Cloud. Implement data quali...
Skills
Sign in to read and join the discussion.