Senior Data Engineer - PySpark/Databricks

Job Title : Senior Data Engineer

Location : Noida/Ahmedabad

Employment Type : Full-time

Experience Required : 8 - 12 Years

About the Role/Project :

The role involves maintaining and developing data pipelines, serverless migration, and CI/CD process ownership. The solution product line encompasses several key areas, including marketing analytics, category optimisation, pricing optimisation, customer experience improvement, and sales performance enhancement.

Key Responsibilities :

- Adapt existing pipelines and code for serverless environments, ensuring stable execution.

- Maintain and enhance CI/CD processes, including proposing architectural improvements.

- Monitor pipelines and repositories, review merge requests, and oversee code changes.

- Develop and maintain data pipelines while understanding underlying business logic.

Required Skills & Qualifications:

- 8 years of experience in Data Engineering.

- Strong experience with Databricks.

- Strong experience with PySpark.

- Strong experience with SQL.

- Hands-on experience with CI/CD pipelines.

- Experience with GitHub Actions or similar tools.

- Ability to work independently and take ownership of processes.

- Experience with serverless architectures.

- Understanding of pricing or financial data domains.

Preferred / Good to Have:

- Experience with cascading formula-based financial calculations.

- Familiarity with enterprise client support workflows.

Technology Stack:

- Databricks, PySpark, SQL, GitHub & Serverless compute clusters.