Senior Data Engineer
Description
About the Role
We are looking for a Senior Data Engineer with strong hands-on experience in dbt, Databricks, AWS, and Python. You will design and build scalable data platforms using Medallion architecture. You will also improve existing, imperfect pipelines and make them clean, reliable, and maintainable.
Key Responsibilities
1. Data Pipeline Engineering
Design and implement Medallion architecture (Bronze, Silver, Gold layers) to deliver clean, reliable, analytics-ready data.
Build and maintain transformation workflows in dbt, including modeling, testing, and documentation.
Develop and optimize data processing workloads on Databricks.
Build scalable, fault-tolerant pipelines with proper validation, monitoring, and error handling.
2. Pipeline Architecture Review & Refinement
Assess existing pipelines, including messy or poorly documented legacy code, and refactor them into clean, well-tested solutions.
Improve pipeline architecture for scalability, reliability, performance, and cost efficiency.
Identify technical debt and fix it without disrupting production workloads.
3. Python Development & Automation
Develop production-grade data engineering applications and automation in Python.
Build reusable libraries and utilities for data ingestion and processing.
Implement logging, monitoring, error handling, and testing for pipelines and services.
4. Cloud (AWS)
Work with AWS services (S3, Glue, Lambda, Redshift, CloudWatch) to store, process, and move data securely.
Apply sound cloud, security, and access-control practices to data workloads.
5. Collaboration & Ownership
Work closely with data engineers, software engineers, and business stakeholders.
Own initiatives from design through production deployment and ongoing support.
Requirements
Requirements
5+ years of experience in Data Engineering or a related field.
Strong hands-on experience with dbt.
Strong SQL skills.
Hands-on experience with Databricks.
Working experience with AWS.
Strong proficiency in Python, including building production-grade applications and data pipelines.
Proven experience designing and implementing Medallion architecture.
Ability to work with messy or legacy code and refine pipeline architecture.
Strong understanding of data quality, monitoring, and operational best practices.
Excellent communication skills and ability to work independently.
Work Location: Ahmedabad/Pune
Contact us to apply
If you would like to apply for this role, send your resume to careers@infocusp.com.