Data Engineer
Posted Updated 2
views
Summary
LevelShift is hiring a Data Engineer in Chennai (3-10 years experience) to design, build, and maintain large-scale data pipelines and ETL processes. Core stack is Python, PySpark, Databricks, and SQL/NoSQL databases including Fabric, with focus on data quality and performance troubleshooting.
Roles and Responsibilities :
- Design, develop, test, deploy and maintain large-scale data pipelines using Python, PySpark, and Data Bricks.
- Collaborate with cross-functional teams to gather requirements and deliver high-quality data solutions on time.
- Develop ETL processes to extract insights from various sources such as relational databases (SQL) and NoSQL databases like Fabric.
- Troubleshoot issues related to data quality, performance optimization, and scalability in the production environment.
Job Requirements :
- 3-10 years of experience in a similar role as a Data Engineer or equivalent experience working with big data technologies.
- Strong proficiency in Python programming language along with expertise in PySpark and Data Bricks.
- Experience working with SQL databases including designing schema's creating stored procedures etc.