Azure DevOps Lead Technical Consultant
Description
Job Summary
We are seeking a DevOps Engineer to build, secure, and maintain the cloud infrastructure supporting our Google Gemini Enterprise and Gemini Agents Platform. In this role, you will be responsible for automating CI/CD pipelines for custom GenAI applications, managing agent infrastructure, orchestrating vector databases, and ensuring high availability, low latency, and continuous observability across all deployed AI agent workflows.Key ResponsibilitiesInfrastructure as Code (IaC): Provision and maintain scalable, secure Google Cloud Platform (GCP) environments for Gemini Enterprise and Vertex AI using Terraform or Pulumi.CI/CD & Deployment Automation: Build automated deployment pipelines (GitHub Actions, Cloud Build, or GitLab) for LLM prompts, agent workflows, RAG pipelines, and API middleware. LLM & Agent Operations (MLOps/LLMOps): Set up and manage lifecycle systems for prompt management, model evaluation (evals), fine-tuning pipelines, and vector database indexing (e.g., Vertex AI Vector Search, Pinecone, ChromaDB).Observability & Monitoring: Implement real-time monitoring and alerting for agent latency, token usage costs, API rate limits, model hallucination rates, and system uptime using Cloud Monitoring, Prometheus, Grafana, or OpenTelemetry.Security & Compliance (DevSecOps): Enforce zero-trust access policies (IAM), manage secret injection (Secret Manager), configure VPC service controls, and ensure data boundary protection for sensitive enterprise inputs.Scalability & Performance: Optimize API routing, load balancing, and containerized microservices (GKE / Cloud Run) to support high-throughput, low-latency AI agent operations.
Key Responsibilities
We are seeking a DevOps Engineer to build, secure, and maintain the cloud infrastructure supporting our Google Gemini Enterprise and Gemini Agents Platform. In this role, you will be responsible for automating CI/CD pipelines for custom GenAI applications, managing agent infrastructure, orchestrating vector databases, and ensuring high availability, low latency, and continuous observability across all deployed AI agent workflows.Key ResponsibilitiesInfrastructure as Code (IaC): Provision and maintain scalable, secure Google Cloud Platform (GCP) environments for Gemini Enterprise and Vertex AI using Terraform or Pulumi.CI/CD & Deployment Automation: Build automated deployment pipelines (GitHub Actions, Cloud Build, or GitLab) for LLM prompts, agent workflows, RAG pipelines, and API middleware. LLM & Agent Operations (MLOps/LLMOps): Set up and manage lifecycle systems for prompt management, model evaluation (evals), fine-tuning pipelines, and vector database indexing (e.g., Vertex AI Vector Search, Pinecone, ChromaDB).Observability & Monitoring: Implement real-time monitoring and alerting for agent latency, token usage costs, API rate limits, model hallucination rates, and system uptime using Cloud Monitoring, Prometheus, Grafana, or OpenTelemetry.Security & Compliance (DevSecOps): Enforce zero-trust access policies (IAM), manage secret injection (Secret Manager), configure VPC service controls, and ensure data boundary protection for sensitive enterprise inputs.Scalability & Performance: Optimize API routing, load balancing, and containerized microservices (GKE / Cloud Run) to support high-throughput, low-latency AI agent operations.
Skill Requirements
GCP
IAM
Other Requirements
Skills
- AI
- API
- Automation
- ChromaDB
- CI/CD
- Cloud
- Cloud Run
- DevOps
- DevSecOps
- Fine Tuning
- GCP
- Gemini
- Generative AI
- GitHub
- GitHub Actions
- GitLab
- GKE
- Grafana
- IAM
- Infrastructure as Code
- LLM
- LLMOps
- Microservices
- MLOps
- Model Evaluation
- Observability
- OpenTelemetry
- Pinecone
- Prometheus
- Pulumi
- Terraform
- Vector Databases
- Vector Search
- Vertex AI
- VPC
- Zero Trust
Sign in to read and join the discussion.