Senior Data Engineer II
Posted Updated
Description
Senior Data Engineer II
Location: Bengaluru / Gurugram / Mumbai
About the Role
This is a client-facing Senior Data Engineer role where you'll design and deploy scalable data pipelines, lead cloud migration initiatives, and act as a trusted technical partner to clients on their data platform modernization journeys. You'll work hands-on with Databricks, Spark, and AWS to build governed, high-performance lakehouse architectures, while also guiding and mentoring engineers on your project team.
What You Will Do
- Design and deploy scalable data pipelines handling JSON, Parquet, CSV, and ORC formats for both batch and streaming ingestion
- Build high-performance Spark pipelines to support cloud migration initiatives
- Architect and maintain Medallion Architecture frameworks (Bronze, Silver, Gold tables)
- Optimize on-premises Spark codebases for cloud environments
- Establish data modeling practices aligned with governance standards
- Implement data cataloging using Unity Catalog for data integrity and quality
- Build and manage Delta Live Tables (DLT) pipelines for secure data operations
- Partner directly with clients to shape cloud migration strategy and enforce best practices in design and governance
- Guide and mentor engineers on your project as a technical lead
What We're Looking For
- Minimum 5 years of hands-on data engineering experience, including complex pipeline development and cloud migration projects
- Bachelor's degree (BE/B.Tech) in Computer Science, Data Engineering, or a closely related field
- Advanced proficiency in Spark, SQL, and Python
- Hands-on experience with Databricks (Unity Catalog, Delta Live Tables, Medallion Architecture)
- Solid working knowledge of AWS services; exposure to GCP or Azure is a plus
- Strong communication skills for direct client engagement
- Cloud certification (AWS/GCP/Azure Data Engineering) preferred but not mandatory
Skills
Sign in to read and join the discussion.