Senior Staff Software Engineer, Perception (R4985)
Summary
Senior engineer builds and deploys cutting-edge vision, vision-language, and vision-language-action models for autonomous aircraft, turning research into production-ready perception systems for defense customers.
What You'll Do:
Model Development – Design, train, fine-tune, and maintain state-of-the-art vision, vision-language, and vision-language-action models that improve perception and decision-making for autonomous systems.
Data Pipelines & Model Training – Build scalable data pipelines, supervised fine-tuning (SFT) workflows, and evaluation loops that continuously improve model performance on mission-relevant tasks.
Model Deployment & Optimization – Deploy and optimize machine learning models for embedded hardware using technologies such as ONNX, TensorRT, and hardware-accelerated inference frameworks.
Perception & Autonomy Applications – Apply modern machine learning techniques to solve challenging perception and autonomy problems across aerial and other autonomous systems operating in complex, real-world environments.
Research-to-Production – Translate cutting-edge machine learning research into production-ready capabilities by balancing model performance, robustness, computational efficiency, and operational reliability.
Cross-functional Collaboration – Partner closely with perception, autonomy, platform, and software engineering teams to integrate machine learning capabilities into mission-ready autonomous systems.
Model Evaluation & Validation – Develop benchmarks, testing methodologies, and evaluation frameworks to measure model performance, identify failure modes, and guide future improvements.
Continuous Improvement – Improve training infrastructure, developer tooling, deployment workflows, and model lifecycle management to accelerate experimentation and production delivery.
Required Qualifications:
-
Typically requires a minimum of 10 years of related experience with a Bachelor’s degree; or 9 years and a Master’s degree; or 7 years with a PhD; or equivalent work experience.
-
Mastery of machine learning fundamentals.
-
Experience training an deploying ML models for computer vision in a production setting.
-
Strong understanding of 3D vision problems/algorithms.
-
Experience with machine learning frameworks such as PyTorch and TensorFlow.
-
Demonstrated expertise in deploying models using TensorRT and ONNX.
-
Proficiency in C++ and Python.
-
Strong analytical and problem-solving skills, with the ability to translate research into practical applications.
- Ability to obtain a SECRET clearance
Preferred Qualifications:
-
Experience with developing autonomous systems for defense customers.
-
Experience with training/finetuning vision-language models, vision-language-action models, and/or world models.
-
Contributions to open-source projects in machine learning or computer vision.
-
Track record of publications in leading computer vision and robotics conferences and journals (e.g., CVPR, ICCV/ECCV, RAL, ICRA).
Skills
As published by lever · 20 questions · 9 written answers
Basics
Which location are you applying for?, Resume/CV, Full name, Email, Phone, Current location, Current company, LinkedIn URL, Twitter URL, GitHub URL, Portfolio URL, Other website
Short answers (1)
- Please state your full legal name:
Pick from a list (10)
- Are you authorized to work in the United States?
- Will you require sponsorship for employment now or in the future?
- This position may require access to information and technology that is subject to export controls, such as EAR. Are you any of the following?
- Shield AI provides technology, services, and support to the United States military and allied forces with their various missions. If selected for employment with Shield AI, your contributions will directly relate to and/or support these missions. Are there any reasons why you would not be able to fully contribute in support of the U.S. military and allied forces?
- How did you hear about us?
- Are you a transitioning service member?
- If yes, what partnership program are you working with? optional
- Are you local to or willing to relocate? optional
- What office(s) would you be willing to relocate to? (Select all that apply) optional
- This position requires an Active or the eligibility to obtain a U.S. DoD Secret Security Clearance (U.S. Citizenship Required). optional
Written answers (9)
- If yes, what type of sponsorship? optional
- If you selected "A protected Individual" OR "Other" to the above question, please explain further. optional
- (Optional) If you selected other or would like to expand on the above, feel free to do so below: optional
- If "Industry Conference" or "Other," please provide more details: optional
- If other, please provide further details optional
- When are you available to start your fellowship? optional
- When are you available for full time work? optional
- What full time job(s) are you applying for?
- If you selected international, what location(s)? optional
a16z