Staff Software Engineer ML Platform (6244)
Summary
Backend engineer on Shield AI's ML platform ('AI Factory') team, building experiment-tracking and model-registry services that tie training runs to their data, code, configs and model artifacts so ML engineers can reproduce results. Core tech: Python backend services, APIs, distributed systems, Kubernetes, MLflow.
Job Description:
We are looking for a Senior Software Engineer to build the backend services that make those workflows reliable. You will connect training runs to their data, code and configuration, manage model artifacts and help machine-learning engineers spend less time reconstructing what happened in an experiment.
What you'll do:
-
Build experiment-tracking and model-registry services, integrating tools such as MLflow where appropriate.
-
Connect exact dataset, code and configuration versions to training runs, checkpoints and model versions.
-
Develop APIs and adapters that connect training jobs, data services and artifact storage.
-
Make interrupted or failed workflows recoverable through reliable state handling, retries and useful diagnostics.
-
Make checkpoints, model artifacts and evaluation results easy to find and retrieve for further training, evaluation or deployment.
-
Work directly with machine-learning engineers to simplify their workflows and reduce manual record keeping.
-
Deliver tested services with observability and compatible upgrades across supported cloud and customer-managed environments.
Key Outcomes:
-
Engineers can trace a model version back to the data, code, configuration and run that produced it.
-
Checkpoints and evaluation evidence remain available when jobs fail or workflows change.
-
Developers can compare experiments and retrieve model artifacts through consistent APIs.
-
Teams can reproduce results without manually reconstructing experiment history.
Required qualifications:
-
Experience building production backend services for machine-learning platforms or data-intensive workflows.
-
Strong software engineering skills in Python or a comparable backend language.
-
Experience designing APIs, metadata models and persistent state for services used by other engineers.
-
Experience handling storage, partial failures, retries and consistency in distributed systems.
-
Understanding of training runs, checkpoints and model versioning.
-
Ability to work directly with machine-learning users and deliver maintainable software that solves their workflow problems.
Preferred qualifications:
-
Experience with MLflow, Weights & Biases, model registries or comparable experiment-management tools.
-
Experience integrating Kubernetes jobs, object storage or machine-learning workflow systems.
-
Experience with reproducibility, data provenance or evaluation records.
-
Experience supporting open-source software or on-premises and air-gapped deployments.
Why Join Us
The AI Factory is the foundation for how Shield AI develops and deploys autonomy.
As a Senior Staff Engineer, you will help build the reference architecture used internally by our engineering teams and delivered to customers building their own AI capabilities. Your work will directly impact how quickly researchers can iterate, how efficiently compute resources are utilized, and how AI systems move from experimentation to operational deployment.
This is an opportunity to work at the intersection of modern AI, distributed systems, Kubernetes, and defense, building a platform that enables the next generation of autonomy systems while leveraging the best of the open-source AI ecosystem.
Skills
As published by lever · 17 questions · 8 written answers
Basics
Which location are you applying for?, Resume/CV, Full name, Email, Phone, Current location, Current company, LinkedIn URL, Twitter URL, GitHub URL, Portfolio URL, Other website
Short answers (1)
- Please state your full legal name:
Pick from a list (8)
- Are you authorized to work in the United States?
- Will you require sponsorship for employment now or in the future?
- Shield AI provides technology, services, and support to the United States military and allied forces with their various missions. If selected for employment with Shield AI, your contributions will directly relate to and/or support these missions. Are there any reasons why you would not be able to fully contribute in support of the U.S. military and allied forces?
- How did you hear about us?
- Are you a transitioning service member?
- If yes, what partnership program are you working with? optional
- Are you local to or willing to relocate? optional
- What office(s) would you be willing to relocate to? (Select all that apply) optional
Written answers (8)
- If yes, what type of sponsorship? optional
- (Optional) If you selected other or would like to expand on the above, feel free to do so below: optional
- If "Industry Conference" or "Other," please provide more details: optional
- If other, please provide further details optional
- When are you available to start your fellowship? optional
- When are you available for full time work? optional
- What full time job(s) are you applying for?
- If you selected international, what location(s)? optional
