Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

recruitingfromscratch

NewBe an early applicant

Senior to Staff ML Engineer

Posted Updated
Discussion

Summary

Senior/Staff ML Engineer building the AI intelligence layer for a venture-backed, AI-native startup whose product helps ensure sensitive technologies reach the right parties. Day to day: fine-tuning and serving LLMs, building RAG pipelines and multi-agent systems, and owning private inference infrastructure for production enterprise use.

Who is Recruiting from Scratch:
Recruiting from Scratch is a specialized talent firm dedicated to helping companies build exceptional teams. We partner closely with our clients to deeply understand their needs, then connect them with top-tier candidates who are not only highly skilled but also the right fit for the company’s culture and vision. Our mission is simple: place the best people in the right roles to drive long-term success for both clients and candidates.

About Us

We are building the operational infrastructure that ensures the world's most sensitive technologies reach the right hands, and never the wrong ones.

Our customers include some of the most consequential companies in the world: leading AI labs, aerospace and defense primes, semiconductor giants, quantum computing pioneers, and companies pushing the frontier in chemicals, advanced manufacturing, and robotics.

We are an AI-native, venture-backed company creating a new category of software at the intersection of national security, industrial infrastructure, and enterprise AI.

The Role

As an ML Engineer, you will build and own the intelligence layer at the core of our product: models, pipelines, and agent systems that allow the product to reason over complex, sensitive enterprise data, entirely within controlled, private environments.

This is a production-focused, high-stakes role. You are building systems that real enterprise customers depend on, operating under some of the most demanding security and accuracy requirements in the industry.

What You'll Own

  • Design and own our AI architecture, selecting, fine-tuning, and deploying the right models for each use case within controlled, private environments

  • Build and maintain RAG pipelines that allow models to reason over sensitive, proprietary enterprise data without exposing it to public APIs

  • Fine-tune foundation models on domain-specific data to achieve the classification accuracy and reliability our customers require

  • Design and orchestrate a fleet of specialized AI agents, including agents that process and tag internal enterprise documents and agents that monitor and analyze external data sources

  • Build evaluation frameworks, benchmarks, and observability tooling to ensure model reliability, accuracy, and auditability in production

  • Own the private inference infrastructure, ensuring all AI runs in controlled environments that meet the security posture of our most demanding customers

  • Work closely with platform and infrastructure teams to ensure AI systems are integrated securely and can scale across the product

What We're Looking For

  • 4+ years of experience in AI/ML engineering with a strong emphasis on production systems

  • Deep experience fine-tuning and evaluating large language models for domain-specific applications; you know how to get reliable, accurate results from existing models, not just benchmark performance

  • Strong experience building RAG systems, retrieval architecture, chunking strategies, embedding models, and evaluation

  • Experience designing and deploying multi-agent systems: orchestration, tool use, failure modes, and observability

  • Open-Weight Model Adaptation: Hands-on experience fine-tuning (LoRA/QLoRA, full fine-tuning) and serving open-weight models locally, with a deep understanding of optimizing inference latency, throughput, and memory constraints in air-gapped or restricted infrastructure without relying on external APIs.

  • Strong software engineering fundamentals; you build and ship production systems, not just proofs of concept

  • Experience with information extraction, document classification, or NLP at scale is a strong plus

  • Based in or willing to relocate to New York City

What we offer

  • Competitive compensation commensurate with experience

  • Meaningful equity in a company at an early and critical stage of growth

  • Comprehensive benefits including health, dental, and vision

  • The opportunity to build proprietary AI at the frontier of national security infrastructure

  • Direct access to leadership and genuine influence over how it's built

Equal opportunity & eligibility

  • We are an equal opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

  • This role requires access to export-controlled information, as a result, applicants must be U.S. persons (citizens, lawful permanent residents, refugees, or asylees) as defined under applicable U.S. law.

  • Start date is immediate, with flexibility for the right candidate. If you are not based in New York, we can accommodate remote work for an initial period and offer relocation assistance on a case-by-case basis.

Skills

What Staff ML / AI jobs ask for — and how much of it you have →
Apply

See also

ML / AI jobs by country — openings, pay and top skills →