DevOps Engineer

About the role

The DevOps Engineer with LLMOps focus is responsible for building and maintaining CI/CD pipelines, automation, and operational tooling that enable Insight's AI Development team to ship AI‑powered applications reliably and at speed. Beyond traditional DevOps, you will develop specialized pipelines for deploying, monitoring, and managing LLM‑based applications— including prompt versioning, model endpoint management, and AI‑specific observability. You are the bridge between development and production.

Responsibilities

• Design, build, and maintain CI/CD pipelines for application and AI model deployment using Azure DevOps or GitHub Actions.
• Implement LLMOps practices such as prompt versioning, model endpoint management, A/B testing of model configurations, and automated evaluation pipelines.
• Containerize applications using Docker and manage deployments to Azure Kubernetes Service (AKS) or Azure App Services.
• Automate infrastructure provisioning, configuration management, and environment setup in collaboration with Platform Engineers.
• Implement monitoring, logging, and alerting for both application services and AI model endpoints (latency, token usage, error rates, output quality).
• Manage secrets, credentials, and access controls across deployment environments.
• Support development teams with build/release troubleshooting, environment issues, and deployment best practices.
• Maintain runbooks and operational documentation for incident response and release procedures.

Qualifications

• Minimum 3 years of experience in a DevOps, SRE, or release engineering role.
• Strong hands‑on experience building and managing pipelines with Azure DevOps, GitHub Actions, or similar tools.
• Proficiency with Docker; experience with Kubernetes (AKS) or container orchestration platforms.
• Working knowledge of Microsoft Azure services for compute, networking, and identity.
• Proficiency in Python, Bash, or PowerShell for automation and tooling.
• Experience with monitoring and observability tools (Azure Monitor, Application Insights, Prometheus, Grafana, or similar).
• Familiarity with deploying and monitoring LLM‑based applications (prompt management, model endpoint monitoring, evaluation pipelines) is a strong plus.
• Strong English communication skills; collaborative and comfortable working in Agile teams.
• Nice to have: experience with IaC tools (Terraform, Bicep); familiarity with MLflow, Databricks, or AI model lifecycle management.

Benefits

• Freedom to work from another location—including an international destination—for up to 30 consecutive calendar days per year.
• Health Management Organization (HMO) on Day1 with coverage for two dependents.

Insight is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, sexual orientation or any other characteristic protected by law.