Senior Machine Learning Engineer, Vehicle Perception
Summary
Build and deploy perception foundation models for autonomous vehicles, fusing multimodal sensor data to improve 3D scene understanding and safety in Toyota’s mobility systems.
TEAM
WHO ARE WE LOOKING FOR?
RESPONSIBILITIES
- Senior Lead the design and development of perception foundation models for autonomous vehicles, unifying diverse sensor data for scalable 3D scene understanding.
- Deploy scalable and efficient ML models on our autonomous vehicle platform.
- Integrate modern technologies with rigorous safety standards while maintaining cost efficiency.
- Significantly contribute to development of needed components for end-to-end ML training and deployment, from data strategy to optimization and validation.
- Be a champion of the scientific method and critical thinking in inventing state-of-the-art deep learning solutions
- Work in a high-velocity environment and employ agile development practices.
- Collaborate closely with teams such as Perception, Motion Planning, Simulation, Infrastructure, and Tooling to drive unified solutions.
- Work in a hybrid workspace, with the requirement to be present in our Nihonbashi (Japan), Palo Alto (California), or Ann Arbor (Michigan) offices three days per week.
MINIMUM QUALIFICATIONS
-
MS or PhD in Machine Learning, Computer Vision, Robotics or related quantitative fields, or equivalent industry experience.
-
3+ years of experience with Python, any major deep learning framework (PyTorch preferred), and software engineering best practices
-
3+ years of experience with deep learning approaches such as supervised/unsupervised learning, transfer learning, multi-task learning, and/or deep reinforcement learning.
-
3+ years of experience covering machine learning workflows, data sampling and curation, pre-processing, model training, ablation studies, evaluation, deployment, and inference optimization.
-
Experience working with large-scale foundation models, including pretraining, multimodal architectures, self-supervised learning approaches.
-
Deep understanding of runtime complexity, distributed/cloud ML infrastructure, data pipeline architecture,resource-aware optimization.
-
Comfortable in writing C++ code to help integrate with our autonomous vehicle platform.
-
Strong leadership skills to influence others and the team's technical strategy.
-
Strong communication skills with the ability to communicate concepts clearly and precisely.
NICE TO HAVES
-
Published research at top-tier conferences (NeurIPs, CVPR and similar).
-
Proven track record of deploying ML models at scale in self-driving or related fields.
-
Experience with offboard, auto-labeling, or "data-engine" pipelines, including mining, curation, active learning, and ground-truth-free evaluation for large-scale datasets.
-
Hands-on experience with vision-language models (VLMs), world models, video prediction, or latent dynamics models for autonomous systems or robotics.
-
Experience leveraging foundation models across multiple platforms and sensor setups, including distilling larger models into efficient real-time variants.
-
Familiarity with production-level coding and deployment onto embedded platforms, optimizing for latency and hardware constraints.
-
Experience in self-driving challenges (Perception, Prediction, Mapping, Localization, Planning, Simulation).
Your base salary is one part of your total compensation. We offer a base salary, short term and long term incentives, and a comprehensive benefits package. The total compensation offered to an employee will be dependent upon the individual's skills, experience, qualifications, location, and level.
Skills
As published by lever · 6 questions
Basics
Resume/CV, Full name, Pronouns, Email, Phone, Current location, Current company, LinkedIn URL, X URL, GitHub URL, Portfolio URL, Other website, I identify my race/ethnicity asSelect all that apply, What gender do you identify as?, Do you consider yourself a member of the Lesbian, Gay, Bisexual and/or Transgender, Queer and Questioning (LGBTQ) community?, Do you identify as a Protected Veteran defined as one of the following: Disabled veteran; Recently separated veteran; Active wartime or campaign badge veteran; Armed Forces service medal veteran?
Pick from a list (6)
- Woven by Toyota conducts a thorough pre-employment background check as a condition of employment. This check may include verification of your education, employment history, criminal history, and any other relevant information. If you accept an offer of employment, you consent to this background check and acknowledge that any employment offer is contingent upon satisfactory results. optional
- Please review and acknowledge you read and understood the non-disclosure agreement at the following link: https://woven.toyota/en/careers/nda/ optional
- By submitting your application you agree to the handling of your personal data as described in the applicant privacy notice: https://woven.toyota/en/applicant-privacy-notice optional
- U.S. export control laws, including the regulations of the Export Administration Regulations (“EAR”) at 15 CFR Parts 730-774 and the International Traffic in Arms Regulations (“ITAR”) at 22 CFR Parts 120 - 130, require that export licenses or specific authorization prior to providing controlled technologies, services, or software to certain foreign nationals be obtained. The following questions are solely for export controls compliance purposes. Your responses are confidential and will be used solely to assess compliance with applicable U.S. Export Control Laws.
- Are you one of the following: • U.S. Citizen or National. • U.S. Lawful Permanent Resident. • Person granted Refugee status in the United States. • Person granted Asylum in the United States.
- Are you a national, citizen, or permanent resident of Belarus, Cuba, Iran, North Korea, Syria, or Russia?