Big Data Engineer
Summary
Design, develop, and optimize large-scale data processing solutions and high-performance data pipelines using Spark, Scala, and the Hadoop ecosystem for distributed analytics platforms.
Role: Big Data Engineer
Experience: 6+
Location: PAN
Responsibility:
- Seeking an experienced Big Data Engineer with strong expertise in Spark, Scala, and Hadoop ecosystem technologies to design, develop, and optimize large-scale data processing solutions. ·
- The candidate will be responsible for building high-performance data pipelines, managing distributed systems, and enabling scalable analytics platforms. ·
- Required Skills: Apache Spark, Scala, Hadoop Ecosystem (HDFS, Hive, Yarn), SQL & Data Modeling, Distributed Computing Concepts, ETL/Data Pipeline Development ·
- Preferred Skills: Apache NiFi, Apache Kafka, AWS Services, Airflow, CI/CD & DevOps