GCP Data Engineer
Posted
Summary
A mid-level data engineer (3-7 years) builds and operates large-scale enterprise data solutions on Google Cloud Platform day to day, using services like BigQuery, Dataflow, Dataproc, Pub/Sub and Composer, with Terraform for infrastructure and Spark/Scala (Python/Java) for processing production ETL/ELT pipelines.
Mandatory Skills
- Relevant work experience between 3 to 7 years.
- Proficient Experience on designing, building and operationalizing large-scale enterprise data solutions using at least four GCP services among Data Flow, Data Proc, Pub Sub, BigQuery, Cloud Functions, Composer, GCS
- Must have hands on experience in Terraform
- Proficient hands-on programming experience in Spark/Scala (python/java)
- Proficient in building production level ETL/ELT data pipelines from data ingestion to consumption
- Data Engineering knowledge (such as Data Lake, Data warehouse - Redshift/Hive/Snowflake, Integration, Migration)
- Excellent communicator (written and verbal formal and informal)
- Experience using software version control tools (Git/Bitbucket/code commit).
- Flexible and proactive/self-motivated working style with strong personal ownership of problem resolution.
- Ability to multi-task under pressure and work independently with minimal supervision.
- Must be a team player and enjoy working in a cooperative and collaborative team environment.
Desired Skills and Experience (Good to Have):
- GCP Certification preferred.
Additional Cloud experience in AWS or Azure preferred