Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Handshake

Senior ML Infra Engineer – Scalable AI Platform

Posted Updated

Description

Handshake is seeking a Senior Software Engineer to join the ML Infrastructure & Platform team. You will build and operate shared infra behind Handshake’s core marketplace and Handshake AI, enabling scalable production ML and AI systems.

You’ll work at the intersection of software engineering, machine learning, and generative AI, moving models from prototype to production while ensuring reliability, performance, and cost efficiency across pipelines and services.

Build and operate the shared infrastructure behind production ML and AI. Scale our LLM platform with provider integrations, orchestration, observability, and cost controls. Create evaluation infrastructure and quality measurement pipelines. Support post-training workflows including fine-tuning and RL pipelines. Optimize inference for open and fine-tuned models with GPU serving and autoscaling. Collaborate with AI, Data Science, and Product teams to productionize models. 5+ years of production software engineering experience. Experience building and operating cloud infrastructure on AWS, GCP, or similar. Strong experience with Kubernetes, Docker, Terraform, CI/CD, and operating production services. Hands-on experience building ML infrastructure, including model serving and training pipelines. Experience with BigQuery, Airflow, Spark, Beam/Dataflow, or streaming pipelines. Experience with LLMs or generative AI systems and related tooling. Equity in a fast-growing company 401(k) match Parental leave Medical, dental, and vision Learning stipend Remote & Office Flexible PTO Team outings Referral bonuses

Skills

Apply

Other locations (2)

See also