Data Engineer (Python/Pyspark)
Posted Updated
Description
Tata Consultancy Services Limited is seeking a Data Engineer (Python/PySpark) to design and implement scalable data pipelines and ETL/ELT workflows for large datasets. The role emphasizes Python and Spark expertise, SQL fluency, and cloud exposure across AWS/Azure/GCP.
You will collaborate with data architects and engineers to transform and validate data from multiple sources, optimize pipelines, and support analytics workloads with robust data solutions.
Develop scalable data pipelines using Python and PySpark. Build and optimize ETL/ELT workflows for large datasets. Perform data transformation, cleansing, and validation. Write complex SQL queries and optimize data-processing workloads. Work with Spark-based distributed data-processing solutions. Integrate data from multiple structured and unstructured sources. Monitor and troubleshoot data pipelines and production issues. Collaborate with data architects, analysts, and engineering teams. Develop scalable data pipelines using Python and PySpark. Build and optimize ETL/ELT workflows for large datasets. Perform data transformation, cleansing, and validation. Write complex SQL queries and optimize data-processing workloads. Work with Spark-based distributed data-processing solutions.Skills
Sign in to read and join the discussion.