Scala Spark Engineer - Data Engineering

Scala Spark Engineer | Bangalore | Hybrid | GCP | Immediate Opportunity | Contract 6-12 M

Key Responsibilities :

- Design, develop, and optimize scalable Apache Spark applications using Scala.

- Build and maintain high-performance ETL/ELT pipelines on Google Cloud Platform (GCP).

- Develop data solutions using Dataproc, BigQuery, and Cloud Storage.

- Write optimized SQL queries using BigQuery SQL.

- Work with Kafka for real-time data processing and streaming.

- Develop automation scripts using Unix/Linux Shell Scripting.

- Collaborate with cross-functional teams to deliver robust, scalable data solutions.

- Follow Git-based development practices and CI/CD deployment processes.

Required Skills :

- 4-6 years of hands-on experience in Data Engineering.

- Strong expertise in Scala and Apache Spark.

- Hands-on experience with Google Cloud Platform (Dataproc, BigQuery, Cloud Storage).

- Strong SQL skills, preferably BigQuery SQL.

- Familiarity with Kafka messaging platform.

- Experience in Unix/Linux Shell Scripting.

- Knowledge of Git and CI/CD pipelines.

- Excellent debugging, analytical, and problem-solving skills.

- Strong communication and documentation abilities.