Hadoop Data Engineer

Strongly Desired competencies:

We are looking for Language agnostic people, however, below is the end to end tech stack we intend to use for developing our SEAT platforms.

• Hadoop Hive, HDFS , iceberg , Star Rocks
• Hands-on skills in Spark, Scala , python / Flink , Airflow
• Cloud Solutions – working on Azure
• Containers Management – using tools like Docker,
• Continuous Integration – using tools like Maven, Gradle and ADO CI / CD ADO pipeline
• Collaboration – using tools like Git-Hub and ADO
• Understanding of continuous build concept and usage with maven, sonarqube or other related tools
• Preferred competencies:
• Spark Application Design
• Dev Ops Tools and CI/CD Processes – ADO
• Performance Improvement / Analysis skills
• Integration Patterns and best practices
• Data Analytics and Data Loading Techniques
• Resource monitoring / Benchmarking standards
• Qualifications & Experience:
• 8+ years of experience in developing world class products/applications.
• Bachelors in Engineering or equival