GCP Data Engineer
Posted Updated
Summary
Designs, builds, and operationalizes large-scale enterprise data solutions on Google Cloud Platform (BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Functions, Composer, GCS), with hands-on Spark/Scala (Python/Java) programming and production ETL/ELT pipeline development. Aimed at engineers with 4-7 years of relevant experience; Terraform is also highlighted.
GCP Data Engineer , Terraform
Mandatory Skills
- Relevant work experience between 4 to 7 years.
- Proficient Experience on designing, building and operationalizing large-scale enterprise data solutions using at least four GCP services among Data Flow, Data Proc, Pub Sub, BigQuery, Cloud Functions, Composer, GCS
- Proficient hands-on programming experience in Spark/Scala (python/java)
- Proficient in building production level ETL/ELT data pipelines from data ingestion to consumption
- Data Engineering knowledge (such as Data Lake, Data warehouse - Redshift/Hive/Snowflake, Integration, Migration)
- Excellent communicator (written and verbal formal and informal)
- Experience using software version control tools (Git/Bitbucket/code commit).
- Flexible and proactive/self-motivated working style with strong personal ownership of problem resolution.
- Ability to multi-task under pressure and work independently with minimal supervision.
- Must be a team player and enjoy working in a cooperative and collaborative team environment.
Desired Skills and Experience (Good to Have):
- GCP Certification preferred.
- Additional Cloud experience in AWS or Azure preferred.
Qualification
- Completed undergraduate degree with outstanding academic credentials (preferably a technical undergrad degree e.g. Computer Science, Engineering)