Data Engineer

Job Description Data Engineer

Job Title: Data Engineer
Location: Chennai
Employment Type: Full-Time

Job Summary

We are looking for a skilled Data Engineer to design, develop, and maintain scalable data pipelines and data processing solutions. The ideal candidate should have strong experience in PySpark, SQL, Python, cloud platforms (AWS/Azure/GCP), and ETL pipeline development. The candidate will be responsible for transforming raw data into reliable, high-quality datasets to support analytics and business intelligence.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark and Python.
• Write, optimize, and troubleshoot complex SQL queries.
• Develop and maintain ETL/ELT pipelines for data extraction, transformation, and loading.
• Work with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform (GCP).
• Perform data cleansing, transformation, validation, and quality checks.
• Optimize data processing workflows for performance, scalability, and reliability.
• Collaborate with data analysts, data scientists, and other technical teams to understand data requirements.
• Monitor pipeline performance, troubleshoot failures, and implement solutions.
• Maintain technical documentation for data workflows, processes, and architecture.
• Follow best practices for data security, governance, and access management.

Required Skills & Relevant Experience

Skill SetRelevant Experience (Years)PySpark___ yearsSQL___ yearsPython___ yearsAWS / Azure / GCP___ yearsETL Pipeline Development___ years

Required Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• Strong hands-on experience in PySpark, SQL, Python, and ETL pipeline development.
• Practical experience with at least one cloud platform: AWS, Azure, or GCP.
• Understanding of data warehousing, data modelling, and distributed data processing.
• Strong analytical, problem-solving, and debugging skills.
• Ability to work collaboratively in a team-oriented environment.

Preferred Skills

• Experience with Apache Spark and distributed computing.
• Familiarity with cloud-based data services and storage solutions.
• Knowledge of workflow orchestration tools and scheduling frameworks.
• Experience with Git, CI/CD, and data pipeline monitoring tools.

How to Apply

Interested candidates can share their updated resume along with their relevant experience in the required skill sets listed above.