Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Qloron

MLOps Engineer

Posted Updated

Description

JOB ID : QT- AJh- 08-600

Job Summary

We are looking for an experienced MLOps Engineer to own the operational infrastructure of our AI/ML platform. The role will focus on deploying machine learning models reliably into production, building scalable ML infrastructure, implementing CI/CD automation, and ensuring continuous monitoring of model performance, reliability, and data quality.
The ideal candidate will have strong hands-on experience with Python, MLflow, Databricks, Docker, Kubernetes, CI/CD, cloud platforms, model serving, monitoring, and automated retraining. You will establish MLOps standards and own the complete model lifecycle from model handoff through production deployment, monitoring, rollback, and retraining.

Key Responsibilities

ML Infrastructure & MLOps

  • Design, build, and maintain ML infrastructure for production machine learning workloads.
  • Set up and manage MLflow experiment tracking, model registry, feature management, and model serving infrastructure.
  • Establish MLOps standards for model versioning, experiment tracking, deployment, and production readiness.
  • Define governance and release standards for ML models before production deployment.
  • Build reusable MLOps frameworks and automation for ML Engineers and Data Scientists.

Model Deployment & Serving

  • Own the complete production deployment lifecycle from trained model handoff to stable and monitored production endpoints.
  • Deploy and manage models using BentoML, TorchServe, TensorFlow Serving, Databricks Model Serving, or equivalent technologies.
  • Design scalable real-time inference infrastructure with appropriate latency, throughput, availability, and reliability.
  • Implement model versioning, canary/blue-green deployments, rollback, and release strategies.
  • Develop fallback mechanisms that allow systems to gracefully switch to rule-based logic when model confidence or reliability falls below defined thresholds.
  • Optimize inference workloads for performance, scalability, and cost.

CI/CD & Automation

  • Build and maintain CI/CD pipelines for ML model training, validation, packaging, deployment, and rollback.
  • Automate model testing, validation, security checks, artifact management, and production releases.
  • Implement Git-based development and deployment workflows using GitHub Actions, GitLab CI, Jenkins, or equivalent.
  • Integrate infrastructure and ML deployment pipelines with automated quality gates.

Monitoring & Model Performance

  • Build monitoring solutions and dashboards for:
    • Model accuracy and quality
    • Prediction latency
    • Throughput
    • Availability
    • Resource utilization
    • Data quality
    • Data drift and model drift
  • Implement monitoring and alerting using Prometheus, Grafana, or equivalent tools.
  • Define appropriate performance thresholds and SLAs for production models.
  • Implement automated detection of data drift, model degradation, and abnormal prediction behaviour.
  • Establish feedback loops between application-level validation outcomes and model improvement workflows.

Automated Retraining

  • Design and implement automated model retraining pipelines.
  • Trigger retraining based on data drift, model performance degradation, business thresholds, or scheduled intervals.
  • Automate the complete retraining lifecycle including data validation, model training, evaluation, registration, approval, and deployment.
  • Ensure retrained models meet defined quality and production-readiness criteria before release.

Production Reliability

  • Own production readiness for ML systems, including monitoring, alerting, runbooks, operational documentation, and incident response.
  • Work closely with Backend Engineers and Data Scientists to ensure inference services meet application-level latency and reliability requirements.
  • Conduct load testing, stress testing, performance optimization, and capacity planning.
  • Troubleshoot production ML infrastructure, deployment, serving, and performance issues.
  • Participate in incident management and root-cause analysis for ML production issues.

Infrastructure & Cloud

  • Containerize ML workloads using Docker.
  • Deploy and manage ML workloads on Kubernetes or equivalent container orchestration platforms.
  • Implement Infrastructure-as-Code using Terraform or equivalent technologies.
  • Build scalable and secure ML infrastructure on AWS, Azure, or GCP.
  • Optimize infrastructure for reliability, scalability, observability, and cost efficiency.

Required Qualifications

Education

  • B.E. / B.Tech / M.Tech in Computer Science, Information Technology, Engineering, or a related technical field.

Experience

  • 5+ years of overall software/data/ML engineering experience.
  • Minimum 3+ years of hands-on experience in MLOps or ML infrastructure in production environments.
  • Proven experience deploying, monitoring, and maintaining ML models at production scale.
  • Strong experience building automated ML deployment, monitoring, and retraining pipelines.
  • Experience working with cross-functional teams including Data Scientists, ML Engineers, Backend Engineers, and DevOps teams.

Mandatory Technical Skills

  • Python – Strong programming and automation skills.
  • MLflow – Experiment tracking, model registry, model lifecycle management.
  • Databricks – MLOps and ML platform experience strongly preferred.
  • Docker – Containerization of ML applications and services.
  • Kubernetes – Production deployment and orchestration of ML workloads.
  • CI/CD – GitHub Actions, GitLab CI, Jenkins, Azure DevOps, or equivalent.
  • Model Serving – BentoML, TorchServe, TensorFlow Serving, Databricks Model Serving, or equivalent.
  • Monitoring – Prometheus, Grafana, or equivalent observability platforms.
  • Infrastructure-as-Code – Terraform or equivalent.
  • Cloud – Hands-on experience with at least one of AWS, Azure, or GCP.
  • Bash/Shell scripting for automation and infrastructure operations.
  • Understanding of model drift, data drift, model versioning, retraining, rollback, and production monitoring.

Good to Have

  • Experience with Databricks Model Serving and Databricks Workflows.
  • Experience with feature stores and feature management platforms.
  • Knowledge of KServe, Seldon, Ray Serve, or similar model-serving technologies.
  • Experience with Kafka or event-driven ML inference pipelines.
  • Experience with distributed computing and large-scale ML workloads.
  • Knowledge of OpenTelemetry and centralized logging.
  • Experience implementing ML governance and model approval workflows.
  • Understanding of security, compliance, and audit requirements for production AI/ML systems.

Key Competencies

  • Strong production engineering mindset.
  • Excellent troubleshooting and problem-solving skills.
  • Strong understanding of scalable infrastructure and distributed systems.
  • Ability to establish and enforce MLOps best practices.
  • Strong ownership of production systems and incident management.
  • Ability to work effectively with Data Scientists, ML Engineers, Backend Engineers, and DevOps teams.
  • Strong documentation and communication skills.

Skills

Apply

See also

DevOps jobs by country — openings, pay and top skills →