Senior Data Engineer
Summary
Acclime is hiring a Senior Data Engineer in Ahmedabad to architect, build, and optimize scalable data pipelines using Azure Data Services (Data Factory, Synapse), Azure DevOps, and select AWS components. Day to day involves monitoring pipeline health and costs, enforcing data quality with dbt tests, and supporting stakeholders and on-call incidents.
Job Description
Key Responsibilities Architect, maintain, and optimize scalable data pipelines, leveraging Azure Data Services, Azure DevOps, and select AWS components. Build and maintain pipelines in Azure Data Factory and/or Azure Synapse Analytics Pipelines. Monitor pipeline health and costs using Azure Monitor, Log Analytics, and custom dashboards. Assemble and manage large, complex datasets that meet functional and non-functional business requirements. Implement and maintain data quality frameworks using tools such as dbt tests and monitoring solutions. Collaborate with business intelligence analysts, data scientists and business stakeholders to understand requirements and deliver tailored solutions. Develop and maintain technical documentation, workflows, and best practices to ensure knowledge sharing across teams. Provide support for data-related incidents and participate in an on-call rotation when necessary. Demonstrate willingness to explore and learn new technologies and tools as our data ecosystem evolves and show enthusiasm for adopting upcoming technologies