Big Data Engineer
Summary
Builds and maintains GCP-based data pipelines, optimizes BigQuery SQL models, and processes data with Python, Hive, and PySpark.
Big Data Engineer with GCP
Location: Phoenix, AZ
Big Data Engineer with GCP
Responsibilities:
· Build and maintain data pipelines on GCP.
· Optimize SQL queries and data models in BigQuery.
· Use Python for data processing and automation.
· Work with Hive and PySpark for large-scale data analysis.
· Ensure data integrity and workflow efficiency.
Requirements:
· Experience with GCP, SQL, BigQuery, Python, Hive, and PySpark.· Experience with the Lumi framework.
· Strong problem-solving and analytical skills.
· Effective communication and collaboration.