Pyspark Data Engineer
Posted 4
views
Summary
PySpark Data Engineer at Tata Consultancy Services in Chennai, building real-time and batch data pipelines covering ingestion, transformation, and storage using PySpark, Apache Spark, Python, Spark SQL, and Spark Streaming with Kafka on cloud platforms (AWS, Azure, or GCP). Open to candidates with 4-15 years of experience.
Role/Skill- Pyspark Data Engineer
Experience - 4 to 15 Years
Location- Chennai
JD:
Required Skills:
- PySpark: In-depth knowledge of PySpark, Apache Spark, and Python.
- Data Processing: Strong understanding of data processing concepts, including data ingestion, data transformation, and data storage.
- Cloud Experience: Experience with cloud-based data platforms, including AWS, Azure, or Google Cloud.
- Expertise in DataFrames & Spark SQL, Spark Streaming with Apache Kafka real-time data ingestion pipelines