ETL Test Lead

Job Title : ETL Test Lead

Role type : Contractual/Remote

Experience Required : 7+ years

Timezone : IST

Work Mode : Remote

Must Have : AWS, Python, Pyspark

Job Description :

The ETL Test Lead is a contractual and remote position that requires a highly skilled professional with 7+ years of experience in the field. The ideal candidate will have expertise in AWS, Python, and Pyspark, and will be working in the IST timezone.

Key Responsibilities :

- Lead the testing efforts for ETL processes, ensuring data quality and integrity

- Design and implement test automation scripts using Python and Pyspark

- Collaborate with cross-functional teams to identify and prioritize testing requirements

- Develop and execute API testing using tools such as Postman and REST Assured

- Work with large-scale data validation using PySpark or Spark

Technical Expertise Required :

- AWS data services : Glue, S3, EMR, Redshift, Kinesis, Lambda.

- NoSQL databases : MongoDB, Couchbase, Redis, or DynamoDB.

- Strong SQL skills (PostgreSQL, MySQL, Redshift) for data validation queries.

- API testing tools : Postman, REST Assured, or similar.

- Python for test automation scripting.

- Hands-on experience with Apache Kafka and event-driven testing.

- Docker, Kubernetes, and CI/CD pipeline integration.

- PySpark or Spark for large-scale data validation.

Good to Have :

- TypeScript or JavaScript for test automation scripting.

- Retail domain experience - MMS, POS, inventory, order management.

- Contract testing (Pact) for microservices boundary validation.

- Familiarity with data quality frameworks (Great Expectations, Deequ).

- Exposure to Domain-Driven Design (DDD) or event sourcing.