Python and Pyspark Developer

Skills: Python, Pyspark, SQL, UNIX.

Experience: 4 to 12Yrs

Interview Date: 31st Oct 26

Timings: Candidates should reach interview location before 11:00 AM.

kindly start sharing profiles for Face to Face to interview Saturday @ Bellandur office, Bangalore & Sholinganallur, Elcot Sez Office @ Chennai.

JD for Pyspark + Python + SQL:

Job Summary**

Seeking a Pyspark Developer with 4-10 years of experience in big data engineering to design, build, and optimize scalable data pipelines on Hadoop ecosystem technologies. The role involves batch/stream processing, data integration, performance tuning, and close collaboration with business teams.

**Key Responsibilities**

• Design and develop robust ETL/data pipelines using Hadoop ecosystem tools.
• Build and optimize large-scale data processing jobs using Spark and/or Hive.
• Write complex SQL/HiveQL for data transformation and reporting needs.
• Ingest structured and unstructured data from multiple sources (Kafka, Sqoop, APIs, files).
• Ensure data quality, lineage, and governance standards are followed.
• Monitor, troubleshoot, and tune jobs for performance and scalability.
• Create technical documentation and follow coding best practices.

**Required Skills**

• 3-8 years of hands-on experience in Pyspark/big data development.
• Strong knowledge of HDFS, Hive, Spark,
• String knowledge in Python/Scala
• Strong SQL and data modelling fundamentals.
• Knowledge with workflow orchestration tools (Airflow).
• Good understanding of Linux, shell scripting, and distributed systems.
• Familiarity with version control (Git) and Agile delivery practices.