Data Engineer

Job Title: Data Engineer Python, PySpark, SQL & Unix

Job Description

We are looking for experienced Data Engineers with strong hands-on expertise in Python, PySpark, SQL, Unix, and Unix Shell Scripting to develop, optimize, and maintain scalable data processing solutions.

Experience: 5-14 Years
Locations: Bangalore / Chennai
Work Mode: Hybrid
Employment Type: Full-Time

Mandatory Skills

• Strong experience in Python programming.
• Hands-on experience with PySpark for large-scale data processing.
• Strong SQL skills, including complex queries and query optimization.
• Good knowledge of Unix/Linux environments.
• Experience in Unix Shell Scripting for automation and batch processing.

Key Responsibilities

• Develop and maintain scalable data pipelines and data processing workflows.
• Build and optimize data transformation solutions using Python and PySpark.
• Write complex SQL queries for data extraction, transformation, and validation.
• Develop shell scripts to automate data processing tasks.
• Troubleshoot data pipeline issues and improve performance.
• Ensure data quality, accuracy, and reliability.
• Collaborate with cross-functional teams to deliver data engineering solutions.

Required Candidate Profile

• 5-14 years of relevant experience in Data Engineering.
• Strong problem-solving and analytical skills.
• Ability to work in a hybrid working environment.
• Candidates should be available to work from Bangalore or Chennai.