Azure Devops with Databricks and Datafactory
Posted
Summary
Azure DevOps engineer role at ITC Infotech in Bangalore, focused on building and maintaining CI/CD pipelines for Azure Data Factory and Azure Databricks deployments, automating infrastructure with Terraform, and managing Azure monitoring, security, and release processes.
Job Title: Azure DevOps Engineer – ADF & Azure Databricks
Location: Bangalore
Key Responsibilities
- Design, implement, and maintain robust Azure DevOps CI/CD pipelines.
- Automate application deployment, testing, and infrastructure provisioning.
- Manage and optimize Azure cloud environments.
- Implement and maintain Infrastructure as Code (IaC) using Terraform.
- Configure and support source control repositories using Git and Azure Repos.
- Manage, deploy, and support Azure Data Factory (ADF) and Azure Databricks (ADB) environments and workloads.
- Develop and maintain CI/CD pipelines for ADF and ADB deployments.
- Monitor application and infrastructure performance using Azure Monitor, Application Insights, and Log Analytics.
- Collaborate with development, QA, security, data engineering, and infrastructure teams to improve release efficiency.
- Implement security best practices, secrets management, and compliance controls.
- Troubleshoot deployment, performance, infrastructure, and data platform-related issues.
- Support release management and environment governance.
Mandatory Skills
Azure DevOps & CI/CD
- Strong hands-on experience with Azure DevOps.
- Experience designing and maintaining CI/CD pipelines.
- Git Version Control and Azure Repos.
- Build automation and release management.
- YAML Pipelines.
Azure Data Platforms – Mandatory
- Strong hands-on experience with Azure Data Factory (ADF).
- Strong hands-on experience with Azure Databricks (ADB).
- Experience building and managing CI/CD pipelines for ADF and ADB deployments.
- Experience supporting data processing and deployment workflows across ADF and Databricks environments.