Big Data Tester
Summary
Test big-data pipelines and ETL jobs on Hadoop/Hive using HiveQL, MapReduce, and Spark, automate validation, and integrate CI/CD with Jenkins and Bitbucket.
Big Data Tester
8 - 16 years of experience
Big Data Testing on Hadoop, Hive, etc., using HiveQL, MapReduce or other big data technologies for automated validation
Implementing DevOps / CI-CD using Bitbucket, Jenkins, etc.,
Implementing Test Automation Frameworks for back-end validation including RDBMS, file, Kafka sources and Big Data targets
Working in an Agile environment on Jira, ALM, Confluence, etc.,
Big Data technologies (Hadoop, Hive, etc.,) using HiveQL, Java-MapReduce / Pig-Latin / Spark-Python or other big data technologies on Linux
Experience with SQL and Shell Scripting experience