Senior Data Engineer
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Engineer based in India.
This is a fully remote opportunity for an experienced data engineer who enjoys solving complex data challenges and owning solutions from design through delivery. You will build scalable, production-grade data pipelines using Microsoft Azure Fabric, Databricks, and modern cloud data services. The role combines hands-on engineering with close collaboration across business and technical teams to turn data requirements into reliable solutions. You will have significant ownership over quality, timelines, performance, scalability, and cost efficiency. AI-assisted development and automation are encouraged to improve engineering productivity and accelerate delivery. This role is ideal for a proactive engineer who thrives in a collaborative, evolving environment and is comfortable working with global stakeholders.
Accountabilities
-
Design, develop, and maintain scalable data pipelines using Microsoft Azure Fabric, Databricks, and Azure data services.
-
Build reliable ETL and ELT processes supporting both structured and unstructured data.
-
Develop enterprise-grade data integration solutions that are secure, scalable, maintainable, and production-ready.
-
Work closely with business stakeholders to understand data requirements and translate them into effective technical solutions.
-
Apply strong data modeling and SQL practices to create efficient and reliable data structures.
-
Optimize data processing workflows for performance, scalability, reliability, and cost efficiency.
-
Use Python, Spark, and related technologies to develop and enhance data engineering solutions where appropriate.
-
Leverage AI-assisted development tools, automation, and modern engineering practices to improve delivery speed and solution quality.
-
Monitor, troubleshoot, and resolve production data issues while proactively identifying opportunities for improvement.
-
Collaborate with architects, analysts, developers, and other technical stakeholders throughout the project lifecycle.
-
Take end-to-end ownership of assigned work, ensuring high-quality delivery and accountability for timelines and outcomes.
-
Proactively identify risks, clarify requirements, communicate progress, and keep stakeholders informed throughout delivery.
-
Adapt to evolving business and technical requirements while maintaining delivery commitments.
-
Collaborate effectively with global teams and provide overlap with U.S. East Coast working hours when critical discussions require it, potentially until 1:00 PM ET.
-
5+ years of hands-on professional experience in Data Engineering or a closely related role.
-
Strong production experience with Microsoft Azure Fabric, Databricks, and Azure data services.
-
Solid knowledge of SQL, data modeling, data integration, and modern data engineering principles.
-
Proven experience designing and building enterprise-grade data pipelines and ETL/ELT solutions.
-
Experience working with cloud-based data platforms in production environments.
-
Proficiency in Python, Apache Spark, or comparable data processing technologies is preferred.
-
Strong understanding of scalable data architecture, pipeline performance, reliability, and optimization.
-
Experience working with both structured and unstructured data.
-
Demonstrated ability to troubleshoot complex data and production issues and implement sustainable solutions.
-
Comfortable using AI tools and automation to improve engineering productivity, solve technical problems, and enhance solution quality.
-
Strong ownership mindset, with the ability to manage work independently and deliver without constant supervision.
-
Proactive communication skills, including the ability to raise risks early, ask clarifying questions, and keep stakeholders informed.
-
Ability to adapt quickly to changing priorities and evolving technical or business requirements.
-
Strong collaboration skills and experience working with cross-functional and global teams.
-
Ability to communicate technical concepts clearly to both technical and business stakeholders.
-
Comfortable working remotely and coordinating effectively across time zones.
-
Must-have technical skills: Databricks, Microsoft Fabric, and Data Engineering.
-
Fully remote, full-time opportunity available to candidates based anywhere in India.
-
Opportunity to work with modern cloud data technologies including Microsoft Azure Fabric and Databricks.
-
High-ownership role with responsibility for solutions from design through production delivery.
-
Opportunity to apply AI-assisted development and automation to real-world data engineering challenges.
-
Exposure to enterprise-scale data pipelines, integration solutions, and cloud-based data platforms.
-
Collaboration with architects, analysts, developers, business stakeholders, and global technical teams.
-
Flexible remote working environment with opportunities for cross-border collaboration.
-
Opportunity to influence engineering practices, solution quality, scalability, and delivery efficiency.
-
Dynamic environment suited to engineers who enjoy solving complex problems and continuously improving how they work.
Requirements
Benefits
Skills
As published by lever
Resume/CV, Full name, Email, Phone, Current location, Current company