Python Data Testing Lead

Python Data Testing Lead-180-220K

Job Code

15233

Locations

Bengaluru

Minimum Experience

6

Maximum Experience

8

Mandatory Skills

ETL Testing,Pyspark,SQL,Data Warehouse Testing,Big Data

Skill to Evaluate

Etl Tester,pyspark,sql

Experience

6 to 8 Years

Location

Bengaluru

Job Description

[About SISC]

Sony India Software Centre (SISC) was setup as a subsidiary of Sony India in the year 1997. In 2012, this organization was established as a separate legal entity as Sony India Software Centre Private Limited (SISCPL). This organization was primarily set-up as a high-quality service delivery center in the areas of embedded software development, enterprise applications development and support, information security services. Since inception, this organization has evolved into a very mature Global Capability Centre providing end to end technology solutions and high value services for global business organizations of Sony.

Python Data Testing Lead Engineer

• Bangalore
• Hybrid
• BTech/BE/MTech/ME
• 6 to 8 years

Job Overview

We are seeking a highly experienced Lead ETL Test Engineer with strong expertise in data validation, data pipelines, and big data ecosystems. The ideal candidate will lead end-to-end testing strategies across data warehouses, ETL pipelines, and modern data platforms, ensuring data quality, integrity, and performance at scale. This role requires deep technical proficiency in big data tools, strong programming skills, and experience with cloud-native environments. Primary Skills

Expertise in ETL testing and data validation across complex pipelines

Strong proficiency in Python programming

Hands-on experience with PySpark and/or Scala for large-scale data processing

Advanced knowledge of SQL, data modeling, and database testing (SQL & NoSQL)

Experience with data warehouses and data lakes (e.g., Snowflake)

Strong experience with Databricks

Deep understanding of Big Data ecosystems

Experience in testing data pipelines and ETL workflows

Strong understanding of data modeling techniques

Input/output validation for ML pipelinesShape

Good to Have Skills

Experience with Apache Flink (streaming and batch processing)

Exposure to CI/CD pipelines (Jenkins, GitLab, etc.)

Knowledge of Docker and Kubernetes for containerized environments

Working knowledge of Linux and shell scripting

Hands-on experience with AWS backend services

Shape

Responsibilities and Duties

Lead end-to-end testing strategy for ETL pipelines, data warehouses, and big data platforms

Design and implement scalable data validation frameworks

Perform database testing across SQL and NoSQL systems

Validate data across data lakes (e.g., Snowflake) and distributed systems

Review and improve test code and automation frameworks

Collaborate with data engineers to ensure data quality and pipeline reliability

Build and maintain automated testing solutions for batch and streaming pipelines

Optimize test processes for performance, scalability, and accuracy

Integrate testing workflows into CI/CD pipelines

Ensure compliance with data governance and quality standards

Keywords

ETL Testing, Data Validation, Data Pipelines, Big Data Testing, Databricks, PySpark, Scala, Python, SQL, NoSQL, Snowflake, Data Lakes, Data Warehousing, Apache Flink, CI/CD, Jenkins, GitLab, Docker, Kubernetes, AWS, Linux, Shell Scripting, Data Modeling

Project Details

Domain: Data Engineering / Big Data

Focus: Testing and validation of enterprise-scale data pipelines and data platforms

Environment: Cloud-based (AWS), distributed data systems, and modern data stack

Tools & Technologies: Databricks, Snowflake, PySpark/Scala, Apache Flink, Python, CI/CD tools, containerized environments

Scope: Build and lead end-to-end testing frameworks ensuring high data quality, consistency, and reliability across batch and streaming systems

Location : Bengaluru