DevOps Engineer (AI Development Team)
Summary
Build and maintain CI/CD pipelines and automation for AI-powered apps, specializing in LLMOps: prompt versioning, model endpoint management, and AI-specific observability on Azure.
DevOps Engineer
Location:
This is a hybrid opportunity where you will work 1 day in the office and 4 days a week from home.
Insight at a Glance
- 14,000+ engaged teammates globally
- $8.2 billion in revenue in 2025
- Certified as a Great Place to work in 9 Countries in 2025
- Fortune 500 Company (No. 447) in 2025
- Received 25+ industry and partner awards in the past year
- $1.4M+ total charitable contributions in 2024 by Insight globally
Now is the time to bring your expertise to Insight. We are not just a tech company; we are a people‑first company. We believe that by unlocking the power of people and technology, we can accelerate transformation and achieve extraordinary results. As a Fortune 500 Solutions Integrator with deep expertise in cloud, data, AI, cybersecurity, and intelligent edge, we guide organizations through complex digital decisions.
About the role
The DevOps Engineer withLLMOpsfocusis responsible forbuilding andmaintainingthe CI/CD pipelines, automation, and operational tooling that enable Insight's AI Development team to ship AI-powered applications reliably and at speed. Beyond traditional DevOps, you will develop specialized pipelines for deploying,monitoring, and managing LLM-based applications — including prompt versioning, model endpoint management, and AI-specific observability. You are the bridge between development and production.Your responsibilities include:
- Design, build, andmaintainCI/CD pipelines for application and AI model deployment using Azure DevOps or GitHub Actions.
- ImplementLLMOpspractices: prompt versioning, model endpoint management, A/B testing of model configurations, and automated evaluation pipelines.
- Containerize applications using Docker and manage deployments to Azure Kubernetes Service (AKS) or Azure App Services.
- Automate infrastructure provisioning, configuration management, and environment setup in collaboration with Platform Engineers.
- Implement monitoring, logging, and alerting for both application services and AI model endpoints (latency, token usage, error rates, output quality).
- Manage secrets, credentials, and access controls across deployment environments.
- Support development teams with build/release troubleshooting, environment issues, and deployment best practices.
- Maintain runbooks and operational documentation for incident response and release procedures.
Be AmbITious: This opportunity is not just about what you do today but also about where you can go tomorrow. When you bring your hunger, heart, and harmony to Insight, your potential will be met with continuous opportunities to upskill, earn promotions, and elevate your career.
What we’re looking for
- Experience: Minimum 3 years of experience ina DevOps, SRE, or release engineeringrole.
- CI/CD: Strong hands‑on experience building and managing pipelines with Azure DevOps, GitHub Actions, or similar tools.
- Containers: Proficiencywith Docker; experience with Kubernetes (AKS) or container orchestration platforms.
- Cloud: Working knowledge of Microsoft Azure services forcompute, networking, and identity.
- Scripting: Proficiencyin Python, Bash, or PowerShell for automation and tooling.
- Monitoring: Experience with monitoring and observability tools (Azure Monitor, Application Insights, Prometheus, Grafana, or similar).
- LLMOps: Familiarity with deploying and monitoring LLM-based applications is a strong plus (prompt management, model endpoint monitoring, evaluation pipelines).
- Communication: Strong English communication skills; collaborative and comfortable working in Agile teams.
- Nice to Have: Experience withIaCtools (Terraform, Bicep); familiarity withMLflow, Databricks, or AI model lifecycle management.
What you can expect
We’re legendary for taking care of you, your family and to help you engage with your local community. We want you to enjoy a full, meaningful life and own your career at Insight. Some of our benefits include:
- Freedom to work from another location—even an international destination—for up to 30 consecutive calendar days per year.
- HMO on Day 1 with 2 free dependent.
But what really sets us apart are our core values of Hunger, Heart, and Harmony, which guide everything we do, from building relationships with teammates, partners, and clients to making a positive impact in our communities.
Join us today, your ambITious journey starts here.
Insight is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, disability status, protected veteran status, orientation or any other characteristic protected by law.
When you apply, please tell us the pronouns you use and any reasonable adjustments you may need during the interview process.
At Insight, we celebrate diversity of skills and experience so even if you don’t feel like your skills are a perfect match - we still want to hear from you!