F2F Drive -24thOCT- Bangalore& Chennai-PySpark Developer-5+ Years

Note: only shortlisted profiles will get interview call letter

Position: Pyspark Developer (Bigdata)

Relevant Experience: 5+ Years

Client: One of our Prestigious client

Locations: Bangalore/Chennai

Mode of hiring: Full time/Permanent

Notice Period: 0-30 days (Immediate), Only Serving notice period (last working day confirmation required) ,, No Bench/Probation

Mode of Interview: Face to face on 24th OCT - Bangalore( Bellandur ) & Chennai( Sholinganallur, Elcot Sez )

Note: only shortlisted profiles will get interview call letter

JD for Pyspark + Python + SQL:

Job Summary**

Seeking a Pyspark Developer with 4-10 years of experience in big data engineering to design, build, and optimize scalable data pipelines on Hadoop ecosystem technologies. The role involves batch/stream processing, data integration, performance tuning, and close collaboration with business teams.

**Key Responsibilities**

• Design and develop robust ETL/data pipelines using Hadoop ecosystem tools.
• Build and optimize large-scale data processing jobs using Spark and/or Hive.
• Write complex SQL/HiveQL for data transformation and reporting needs.
• Ingest structured and unstructured data from multiple sources (Kafka, Sqoop, APIs, files).
• Ensure data quality, lineage, and governance standards are followed.
• Monitor, troubleshoot, and tune jobs for performance and scalability.
• Create technical documentation and follow coding best practices.

**Required Skills**

• 3-8 years of hands-on experience in Pyspark/big data development.
• Strong knowledge of HDFS, Hive, Spark,
• String knowledge in Python/Scala
• Strong SQL and data modelling fundamentals.
• Knowledge with workflow orchestration tools (Airflow).
• Good understanding of Linux, shell scripting, and distributed systems.
• Familiarity with version control (Git) and Agile delivery practices.