Data Engineer - PySpark/Python | Big Data & Cloud | 6+ Years Experience | Any UST Location | Immedia
Posted Updated 2
views
Summary
Senior data engineer (6+ years) at UST building scalable, high-performance ETL pipelines using PySpark/Python, Hadoop/Spark/Hive, AWS Glue/EMR, and GCP Dataproc/BigQuery, with strong SQL and cloud-based data processing optimization at the core of the role.
Job Description
Candidates ready to join immediately can share their details via email for quick processing.
CCTC | ECTC | Notice Period | Location Preference
nitin.patil@ust.com
Act fast for immediate attention!
Must-Have Skills:
- 6+ years of experience in Data Engineering
- Strong expertise in PySpark or Python
- Hands-on experience with Hadoop, Spark, Hive
- Experience with AWS Glue, AWS EMR
- Experience with GCP Dataproc and GCP BigQuery
- Strong ETL and SQL development experience
- Experience in building scalable and high-performance data pipelines
- Strong understanding of cloud-based data processing and optimization
Good-to-Have Skills:
- Experience with Airflow or scheduling/orchestration tools
- Exposure to Kafka or streaming technologies
- CI/CD pipeline knowledge
- Knowledge of Docker/Kubernetes
- Experience in Agile/Scrum environment
- Understanding of data warehousing concepts