Data Engineer (Python/Pyspark)
Posted Updated 26
views
Description
Role- Data Engineer (Python/PySpark)
Desired Experience Range- 4-8 yrs
Location- Kolkata, Chennai, Bangalore
Mandatory Skills
- Python
- PySpark
- Apache Spark
- SQL
- ETL / Data Pipelines
- Data transformation and processing
- Cloud exposure: AWS / Azure / GCP
- Git and CI/CD
Roles & Responsibilities-
- Develop scalable data pipelines using Python and PySpark.
- Build and optimize ETL/ELT workflows for large datasets.
- Perform data transformation, cleansing, and validation.
- Write complex SQL queries and optimize data-processing workloads.
- Work with Spark-based distributed data-processing solutions.
- Integrate data from multiple structured and unstructured sources.
- Monitor and troubleshoot data pipelines and production issues.
- Collaborate with data architects, analysts, and engineering teams.