Data Engineer
Posted
Summary
Designs, builds, and manages secure, scalable data pipelines and processing systems on Google Cloud Platform, turning raw data into actionable insights. Core stack includes BigQuery, GCS, Pub/Sub, Dataflow, Dataproc, and Cloud Composer, with 6-10 years of experience, open to candidates across India.
A Google Cloud Platform (GCP) Data Engineer designs, builds, and manages secure, scalable data processing systems and pipelines to turn raw data into actionable insights.
Exp- 6 to 10
PAN india
Essential Core Skills
- Programming & Querying: Strong proficiency in SQL for data analysis and relational databases, alongside Python or PySpark for automation and pipeline scripting.
- Core GCP Tools: Deep understanding of BigQuery (data warehousing/analytics), Cloud Storage (GCS) (blob storage), and Pub/Sub (real-time messaging).
- Processing & Orchestration: Expertise in Dataflow (batch/streaming via Apache Beam), Dataproc (managed Spark/Hadoop), and Cloud Composer (workflow orchestration via Apache Airflow).
- Modern Data Stack: Familiarity with transformation tools like dbt, Dataform, and data governance frameworks like Dataplex.