Senior Data Engineer
Summary
Senior Data Engineer responsible for architecting and maintaining scalable data pipelines using Azure Data Services, Azure Data Factory, Azure Synapse Analytics, and dbt in an on-site role in Ahmedabad.
Key Responsibilities
- Architect, maintain, and optimize scalable data pipelines, leveraging Azure Data Services, Azure DevOps, and select AWS components.
- Build and maintain pipelines in Azure Data Factory and/or Azure Synapse Analytics Pipelines.
- Monitor pipeline health and costs using Azure Monitor, Log Analytics, and custom dashboards.
- Assemble and manage large, complex datasets that meet functional and non-functional business requirements.
- Implement and maintain data quality frameworks using tools such as dbt tests and monitoring solutions.
- Collaborate with business intelligence analysts, data scientists and business stakeholders to understand requirements and deliver tailored solutions.
- Develop and maintain technical documentation, workflows, and best practices to ensure knowledge sharing across teams.
- Provide support for data-related incidents and participate in an on-call rotation when necessary.
- Demonstrate willingness to explore and learn new technologies and tools as our data ecosystem evolves and show enthusiasm for adopting upcoming technologies