Big Data Developer

We are seeking a highly skilled Big Data Engineer with strong experience in PySpark and Scala to design, build, and optimize large-scale data processing systems. The associate will work on distributed data platforms, enabling real-time and batch analytics solutions across enterprise data ecosystems. The role involves building scalable data pipelines, data lakes, and streaming solutions leveraging modern big data technologies.

This role requires a combination of: Strong PySpark + Scala coding Deep big data architecture knowledge Hands-on experience with streaming + cloud data engineering

Required Skills Core Technologies Strong hands-on experience in: PySpark & Apache Spark Scala programming Expertise in: Spark SQL, DataFrames, RDDs Distributed data processing frameworks