Ai Devops
Description
Senior Engineer 2- Cloud Devops with AI (Azure & GCP)
Role Summary
We are seeking an experienced and hands-on senior engineer-2 to define, architect,
and evolve enterprise AI platforms supporting Machine Learning, Generative AI, and
Agentic AI workloads across Azure and Google Cloud Platform (GCP).
This role combines strategic platform leadership with deep technical expertise and
hands-on engineering. The successful candidate will be responsible for shaping the AI
platform vision, architecture standards, and technology roadmap while actively guiding
implementation of complex AI, MLOps, LLMOps, and cloud platform capabilities.
This engineer will partner closely with business stakeholders, product teams, data
scientists, AI engineers, security teams, and enterprise architects to deliver scalable,
secure, and governed AI capabilities that accelerate business value across the
organization.
As senior engineer the individual will mentor engineering teams, establish architectural
best practices, drive platform maturity, and provide hands-on leadership in solving
complex technical challenges.
Key Responsibilities
AI Cloud Platform Strategy, Architecture & Leadership
Define and own the enterprise AI Platform architecture, technical vision, and
multi-year roadmap across Azure and GCP.
Establish reference architectures, engineering standards, design patterns, and
governance frameworks for AI, ML, Generative AI, and Agentic AI platforms.
Partner with business stakeholders and technology leaders to align platform
capabilities with strategic business objectives.
Identify emerging AI technologies and drive innovation through platform
modernization and continuous capability enhancement.
Lead architecture reviews and make technology selection decisions across AI
platform ecosystems.
Drive platform maturity across reliability, scalability, security, governance,
developer experience, and operational excellence.
Hands-on AI Platform Engineering
Remain actively involved in the design and implementation of critical platform
components and complex technical solutions.
Provide technical leadership for cloud engineering teams through architecture
reviews, design workshops, code reviews, and troubleshooting activities.
Prototype and validate new AI platform capabilities, tooling, and architectural
patterns.
Lead resolution of complex platform, infrastructure, and AI workload challenges.
Contribute to automation, platform engineering, Infrastructure as Code, and
cloud-native engineering initiatives.
MLOps, LLMOps & Generative AI Platforms
Define enterprise standards for MLOps and LLMOps capabilities, including model
lifecycle management, deployment, monitoring, observability, governance, and
operational excellence.
Architect and implement scalable GenAI platform services supporting GPT,
Gemini, Claude, Llama, Mistral, and open-source foundation models.
Design enterprise Retrieval-Augmented Generation (RAG) frameworks, model
evaluation platforms, prompt management solutions, and guardrail architectures.
Establish AI observability frameworks covering performance, hallucination
detection, model quality, latency, reliability, and cost optimization.
Drive Responsible AI adoption through governance controls, model validation,
compliance, and risk management frameworks.
Agentic AI & Intelligent Automation
Define architecture patterns and implementation standards for Agentic AI and
multi-agent systems.
Build and guide implementation of enterprise AI orchestration platforms using
LangGraph, CrewAI, AutoGen, Semantic Kernel, MCP, and emerging
frameworks.
Design secure and governed agent deployment models integrating enterprise
systems, APIs, business processes, and knowledge repositories.
Establish human-in-the-loop governance patterns and operational controls for
autonomous AI systems.
Cloud, Kubernetes & Platform Engineering
Lead architecture and engineering of enterprise Kubernetes platforms on AKS
and GKE supporting AI training and inference workloads.
Design scalable GPU-enabled infrastructure supporting large-scale AI and GenAI
workloads.
Establish best practices for workload isolation, autoscaling, networking, disaster
recovery, security, observability, and platform resilience.
Guide implementation of AI serving technologies including KServe, Ray Serve,
vLLM, Triton Inference Server, and distributed inference architectures.
Drive platform automation, self-service capabilities, and developer productivity
improvements.
DevOps, Automation & Reliability Engineering
Establish Infrastructure as Code and platform automation standards using
Terraform and cloud-native tooling.
Lead implementation of CI/CD, GitOps, and deployment automation for AI and
ML platforms.
Drive Site Reliability Engineering (SRE) practices, platform observability,
operational readiness, and continuous improvement initiatives.
Define platform KPIs, SLAs, SLOs, and engineering health metrics.
Skills
- Agentic AI
- AI
- Ai Enablement
- AKS
- API
- AutoGen
- Automation
- Azure
- CI/CD
- Cloud
- Cloud Native
- CrewAI
- Design Patterns
- Developer Experience
- DevOps
- GCP
- Generative AI
- GitOps
- GKE
- GPU
- Infrastructure as Code
- Kubernetes
- LangGraph
- LLMOps
- Machine Learning
- MCP
- Mistral
- MLOps
- Model Evaluation
- Networking
- Observability
- RAG
- Semantic Kernel
- SRE
- Terraform
- Triton
- vLLM
Sign in to read and join the discussion.