Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Robert Half

NewBe an early applicant

Senior MLOps Engineer

Posted

Who recruits here Pro

Up to three recruiters at Robert Half with their work email, so you can write to a person.

View plans

Part of Pro. How it works

Summary

Senior MLOps Engineer in Tokyo designing and maintaining scalable ML deployment and inference infrastructure, managing GPU-based training/inference workloads, and building production pipelines for ML and LLM applications using Python, Kubernetes, and cloud infrastructure.

The Role

  • Design and maintain scalable ML deployment and inference infrastructure.
  • Manage GPU-based workloads for model training and inference.
  • Build and optimize production pipelines for ML and LLM applications.
  • Improve system reliability, monitoring, and operational efficiency.
  • Collaborate with ML researchers and software engineers to productionize models.
  • Drive technical improvements and introduce new infrastructure solutio

Your Skills

  • 5+ years of experience in MLOps or software engineering with substantial ML infrastructure exposure.
  • Hands-on experience deploying and operating ML models in production.
  • Strong Python, Kubernetes, and cloud infrastructure experience.
  • Experience with GPU computing, distributed systems, and infrastructure automation.
  • Understanding of system monitoring, reliability, and production operations.
  • Strong ownership mindset and ability to work independently.
  • Professional English communication skills.

Key Highlights of the Role

  • Production experience with LLMs or other generative AI models.
  • Experience with high-performance model serving and inference optimization.
  • Familiarity with GPU infrastructure, serving frameworks, and cost optimization.
  • Experience building ML infrastructure at scale.

Location

Tokyo

Salary

10 - 25 million yen

Reference Number: 06940-0013536096

By clicking 'apply', you are deemed to have agreed to Robert Half Japan Privacy Notice (https://www.roberthalf.com/jp/en/privacy). Please ensure that your application documents do not include sensitive personal data such as race, beliefs, medical history, criminal record, or other information irrelevant to hiring process such as spouse or dependents. All information must be accurate and truthful, and any included hyperlinks must be safe and secure.


Skills

What Senior DevOps jobs ask for — and how much of it you have →
Apply

See also

DevOps jobs by country — openings, pay and top skills →