Senior Spark Engineer - Cloudera Data Platform
Summary
A senior data engineer who designs, builds, and optimizes large-scale Spark data pipelines (PySpark, Scala, SQL) on the Cloudera Data Platform, working with HDFS, Hive/Impala, and Spark on YARN. Day to day they also mentor junior engineers, review code, and tune performance and costs.
Indsafri India Private Limited in South Africa seeks a Senior Cloudera Spark Developer to design, develop, and optimize large-scale data pipelines using Spark, Py Spark, Scala, and SQL within a Cloudera environment.
You will mentor juniors, review code, and collaborate with data engineers and scientists to deliver robust data solutions on HDFS, Hive/Impala, and Spark on YARN, while improving performance and reducing costs.
Skills
Sign in to read and join the discussion.