IN_Senior Associate_Junior Data Engineer_GCC_Advisory_Noida
Summary
Junior data engineer in PwC's Global Capability Center (Advisory) in Noida: builds and maintains ETL pipelines with Python, PySpark and SQL on Databricks and cloud data warehouses, monitors pipeline performance, and supports data modeling for client analytics. Requires 1-4 years' experience.
Responsibilities
- Develop and maintain data pipelines using Python and PySpark to extract, transform, and load data from various sources into cloud-based data warehouses.
- Write and optimize complex SQL queries to support data analysis requirements and ensure efficient data retrieval for business intelligence applications.
- Collaborate with senior data engineers to design and implement scalable data architecture solutions using Databricks platform for big data processing.
- Monitor and troubleshoot data pipeline performance issues, implementing necessary fixes to ensure data quality and reliability across cloud environments.
- Assist in building automated ETL processes that integrate data from multiple sources including APIs, databases, and file systems.
- Support data modeling activities by creating and maintaining dimensional models and data marts to facilitate analytical reporting.
- Participate in code reviews and follow best practices for version control, testing, and documentation of data engineering solutions.
- Contribute to cloud infrastructure management tasks including resource optimization and cost monitoring for data processing workloads.
Mandatory Skill Sets
- SQL
- Python
- Pyspark
- Databricks
- Cloud
Preferred Skill Sets
Years of Experience
Education qualification
Degrees/Field of Study
Required Skills
- Generative AI
Optional Skills
- Accepting Feedback
- Active Listening
- AI Fluency
- AI-Human Collaboration
- Algorithm Development
- Alteryx (Automation Platform)
- Analytical Thinking
- Analytic Research
- Big Data
- Business Data Analytics
- Communication
- Complex Data Analysis
- Conducting Research
- Creativity
- Customer Analysis
- Customer Needs Analysis
- Dashboard Creation
- Data Analysis
- Data Analysis Software
- Data Collection
- Data-Driven Insights
- Data Integration
- Data Integrity
- Data Mining
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.