Senior Machine Learning Engineer - AI Foundation
Summary
Builds and optimizes the ML infrastructure behind XPENG's autonomous driving foundation models: designing petabyte-scale training data pipelines, implementing training frameworks for models like VLA 2.0 and robotics, and accelerating distributed training (FSDP, expert/context parallelism) and cloud inference using PyTorch and inference frameworks like vLLM and SGLang.
-
Design and implement training data pipeline that streams data from hundreds of petabytes of labeled and unlabeled data from a fleet of over a million vehicles.
-
Implement training framework for all physical AI foundation models in XPeng, including VLA 2.0, XWorld, Robotics.
-
Accelerate training with state of the art parallelisms, e.g., FSDP, Expert Parallel, Context Parallel, and data types.
-
Accelerate model inference on the cloud for closed-loop simulation, reinforcement learning, and enterprise LLM/VLM applications.
-
Master's Degree in CS/CE/EE, or equivalent, in industry experience.
-
Deep knowledge of PyTorch.
-
Knowledge of model inference framework (e.g. vLLM, SGLang)
-
In-depth knowledge of transformer architecture and ways to accelerate the training and inference of transformer models.
-
Experience of performing large scale distributed training of models.
-
A track record of profiling model and doing detective work to improve model training and inference speed.
-
Previous experience in the autonomous driving industry.
-
Experience with CUDA language for writing custom ops.
-
Experience with edge computing systems.
-
Knowledge of disributed computing frameworks, such as Ray.
-
A track record of efficiently solving complex problems collaboratively on larger teams
-
A fun, supportive and engaging environment.
-
Infrastructures and computational resources to support your work.
-
Opportunity to work on cutting edge technologies with the top talents in the field.
-
Opportunity to make a significant impact on the transportation revolution by the means of advancing autonomous driving.
-
Competitive compensation package.
-
Snacks, lunches, dinners, and fun activities.
Skills
As published by greenhouse · 7 questions · 1 written answer
Basics
First Name, Last Name, Email, Phone, Resume/CV, Cover Letter, Location
Short answers (2)
- LinkedIn Profile optional
- Website optional
Pick from a list (4)
- Have you ever worked at XPENG or any of its affiliates?
- Do you have any family members or relatives working previously or presently at XPENG or any of its affiliates?
- Are you legally authorized to work in the United States?
- Will you now or in the future require sponsorship for an employment visa (e.g., H-1B visa)?
Written answers (1)
- If you answered “Yes” to either of the questions above, please explain.
