Senior Machine Learning Engineer - Perception 3D Segmentation
Summary
Design and optimize deep learning models for 3D perception in autonomous vehicles, fusing LiDAR, camera, and radar data to create real-time occupancy and segmentation maps for safe navigation.
In this role, you will...
-
Design and implement state-of-the-art multi-modal sensor fusion architectures (Lidar, Camera, Radar) to predict 3D occupancy, semantic segmentation, and flow .
-
Develop "vision-first" fusion strategies to enhance geometric understanding and reduce dependency on sparse sensor modalities .
-
Engineer temporal processing modules to improve the stability and consistency of predictions over time.
-
Optimize model architectures for real-time on-vehicle inference, balancing high-fidelity range extension with strict latency constraints .
-
Collaborate with downstream consumers (Tracking, Prediction, Planner) to refine geometric outputs, such as contours and free-space estimations, for complex maneuvering.
Qualifications
-
MS or PhD in Computer Science, Robotics, Machine Learning, or related field with 6+ years of industry experience.
-
Deep expertise in 3D Computer Vision and Deep Learning, specifically with voxel-based or BEV (Bird's Eye View) architectures.
-
Strong proficiency in Python and deep learning frameworks (PyTorch) for model training and design as well as some experience in C++ for model integration.
-
Experience with multi-sensor fusion (Lidar, Camera, Radar) and handling temporal data sequences.
-
Experience with occupancy networks, implicit representations (NeRF/Gaussian Splats), or scene flow estimation.
Bonus Qualifications
-
Experience optimizing models for TensorRT/CUDA to achieve low-latency inference.
-
Familiarity with sparse convolutions or query-based architectures for efficient 3D processing.
-
Experience with Vision Language Model, or multi-modal 3D foundation model, or World Model, or VLA.
Skills
As published by lever · 7 questions · 2 written answers
Basics
Resume/CV, Full name, Pronouns, Email, Phone, Current location, Current company, LinkedIn URL, Other website
Short answers (2)
- Why Zoox?
- If you attended an on-campus or virtual event, which did you attend? optional
Pick from a list (3)
- How did you find out about us?
- Sponsorship: Do you require sponsorship, or will you require sponsorship in the future for employment authorization in the United States? optional
- How did you hear about us? optional
Written answers (2)
- What is your preferred first name and last name? If your legal first and last name is your preferred name, you do not need to respond. optional
- Export Control and Compliance: For the sole purpose of determining export licensing requirements, please list any countries of which you are a citizen or legal permanent resident, and when you obtained such status.