Big Data Engineer
Summary
Core Big Data Engineer role in Chennai or Bengaluru: design, build, and optimize distributed data processing pipelines and scalable big data solutions using Python, Apache Spark/PySpark, Spark SQL, Hadoop/HDFS/Hive, Kubernetes, CI/CD, and Apache Iceberg. Only core big data profiles considered — AWS/Azure/GCP data engineers explicitly excluded.
We're Hiring: Big Data Engineer
We are looking for an experienced Big Data Engineer with strong hands-on expertise in Python, Apache Spark/PySpark, Hadoop, and Hive to build and maintain scalable big data processing solutions.
Location: Chennai/Bengaluru
Experience: 4-10
Notice Period: Upto 45 Days
Key Responsibilities:
- Design, develop, and maintain scalable Big Data processing solutions.
- Build and optimize distributed data processing pipelines using Python and Apache Spark/PySpark.
- Work extensively with the Hadoop ecosystem, including HDFS and Hive.
- Develop and optimize Spark SQL queries for large-scale data processing.
- Integrate data platforms with REST APIs and GraphQL services.
- Work with Kubernetes for container orchestration and deployment.
- Implement and maintain CI/CD pipelines.
- Work with Apache Iceberg for modern data lake and table management solutions.
Required Technical Skills:
- Strong programming experience in Python.
- Hands-on experience with Apache Spark and PySpark.
- Strong knowledge of Hadoop and Hive.
- Experience with Spark SQL.
- Knowledge of REST APIs and GraphQL.
- Experience with Kubernetes and CI/CD.
- Apache Iceberg experience is an added advantage / required for relevant positions.
IMPORTANT STRICT REQUIREMENT
WE ARE LOOKING ONLY FOR CORE BIG DATA ENGINEERS.
AWS Data Engineers – NOT REQUIRED
Azure Data Engineers – NOT REQUIRED
GCP Data Engineers – NOT REQUIRED
Interested candidates can share their updated resumes at: bharadwaj@ambiquest.com.
Please share this opportunity with relevant connections.