Spark/Scala Data Engineer
Summary
Tata Consultancy Services is hiring a Spark/Scala Data Engineer in Chennai to develop big data applications and pipelines. Day-to-day work centers on Apache Spark with Scala/Java (Maven), the Hadoop ecosystem (HDFS, Hive, Sqoop, Kafka), and SQL across Oracle, Hive, Spark SQL, Impala, and HBase.
Hands on development experience in programming languages such as JAVA,SCALA using Maven, Apache Spark Frameworks and Unix Shell scripting
Should be comfortable with Unix File system as well as HDFS commands
Should have worked on query languages such as Oracle SQL, Hive SQL, Spark SQL, Impala, HBase DB
Should be flexible
Should have good communication and customer management skills
Should have knowledge on Big data Data Ingestion tools such as SQOOP and KAFKA.
Should be aware of the components in Big Data ecosystem.
Should have worked on building projects using Eclipse IDE, Tectia Client, Oracle SQL Developer.