Data Engineer

Job Title: Data Engineer Python / PySpark / Unix

Experience: 5-15 Years
Joining: Immediate Joiners Only
Primary Skills: Python, PySpark, Unix
Job Type: Full-Time

Job Description

We are looking for experienced Data Engineers with strong expertise in Python, PySpark, and Unix to develop, maintain, and optimize data processing solutions and scalable data pipelines.

Key Responsibilities

• Develop and maintain data pipelines using Python and PySpark.
• Perform large-scale data processing and transformation.
• Write and optimize Unix shell scripts for automation and data workflows.
• Work with structured and unstructured data for ETL/ELT processes.
• Troubleshoot data processing issues and optimize pipeline performance.
• Collaborate with cross-functional teams to ensure data quality and reliability.

Mandatory Skills

• Strong hands-on experience in Python.
• Good experience in PySpark and distributed data processing.
• Strong knowledge of Unix/Linux commands and shell scripting.
• Experience in data engineering, ETL/ELT, and data pipeline development.

Candidate Requirements

• 5-15 years of relevant experience.
• Immediate joiners only.
• Strong problem-solving and analytical skills.
• Candidates must have hands-on experience in all three mandatory skills: Python, PySpark, and Unix.