Tech jobs

LLM/VLM大模型推理算子优化工程师 - Data AML

APACJunior

团队介绍：Data AML是字节跳动的机器学习中台，为抖音/今日头条/西瓜视频等业务提供推荐/广告/CV/语音/NLP的训练和推理系统。为公司内业务部门提供强大的机器学习算力，并在这些业务的问题上研究一些具有通用性和创新性的算法。同时，也通过火山引擎将一些机器学习/推荐系统的核心能力提供给外部企业客户。 1、深度参与业界先进开源LLM/VLM模型的推理优化部署，构建业界领先的模型推理优化能力；…

C++ CUDA SGLang

ByteDance

多模态大模型推理算子优化工程师 - Data AML

APACJunior

团队介绍：Data AML是字节跳动的机器学习中台，为抖音/今日头条/西瓜视频等业务提供推荐/广告/CV/语音/NLP的训练和推理系统。为公司内业务部门提供强大的机器学习算力，并在这些业务的问题上研究一些具有通用性和创新性的算法。同时，也通过火山引擎将一些机器学习/推荐系统的核心能力提供给外部企业客户。 1、负责Seedance/Seedream基础模型及衍生模型异构卡推理加速工作；…

LLM SGLang

OpenAI

Open 64d HybridNorth AmericaFull-time Licensed UK sponsor Ireland permit employer

Software Engineer, Model Runtime

AI C++ Distributed Systems LLM Observability +5 skills

Build and optimize the LLM inference runtime for frontier models on OpenAI's custom AI silicon, working across C++/Rust/Python with distributed systems, compilers, and hardware co-design.

266K – 445K $

Power Plus Communications

AI API Data Science Embeddings LLM +4 skills

AI Engineer (w/m/d)

Open 64d Europe

Germany

The AI Engineer identifies real-world AI use cases for internal processes, translates business needs into technical solutions, and builds scalable AI tools (e.g., knowledge access, document processing, workflow automation) while ensuring security, compliance, and usability. Focuses on LLMs, embeddings, and system integration for a climate-tech company’s smart energy infrastructure.

ShengShu Technology

大模型Infra工程师 (VLM推理)

CUDA GPU LLM SGLang TensorRT +2 skills

负责 VLM（视觉-语言模型）大规模推理服务的基础设施设计与优化。以极致吞吐与极致成本为核心目标，从服务架构到底层 Kernel 进行全栈压榨，在既定算力预算下支撑尽可能大的业务流量。 1. 推理服务架构设计与优化：主导 VLM 在线推理服务的架构设计与持续演进，深度定制 SGLang 推理框架，针对 VLM 特点（长视觉序列、Prefill/Decode 异构计算）进行系统级适配与优化。持续提升服务吞吐上限，降低单 Token…

ShengShu Technology

大模型Infra工程师 (大模型后训练)

负责生成式大模型后训练阶段（SFT 微调 → 偏好对齐 → 强化学习）的训练基础设施设计与优化。面对算法快速迭代与大规模探索式采样的双重挑战，构建高效、灵活、可扩展的训练框架，在算法演进与系统效率之间实现最优平衡。 1. 后训练全链路框架设计与演进：主导设计并持续迭代后训练基础设施，完整覆盖 SFT（监督微调）→ RM（奖励模型训练）/ DPO（离线偏好优化）→ PPO / GRPO / DAPO（在线强化学习）…

GPU SGLang vLLM

Callosum

Open 68d On-siteUKFull-time Licensed UK sponsor

ML Research Engineer - Member of Technical Staff

United Kingdom

ML Research Engineer at Callosum designing experiments to understand why agentic AI systems fail, building evaluation infrastructure, and publishing findings to improve heterogeneous model/hardware orchestration.

Agentic AI AI Distributed Systems GPU LLM +3 skills

101K – 192K £

Baseten

Open 69d HybridNorth AmericaFull-time

Forward Deployed Engineer (Training)

AI Automation Cloud Deep Learning Distributed Systems +14 skills

Forward Deployed Engineers at Baseten work directly with major AI companies, owning technical outcomes for AI models including inference and post-training systems. They act as technical leads, debug production issues, and contribute to product development across multiple client accounts.

200K – 400K $

d-Matrix

Open 119d HybridNorth AmericaFull-timeStaff H-1B sponsor history

Senior Staff LLM Inference Engineer

AI API Business Development C++ CUDA +14 skills

Join d-Matrix and help build the future of AI inference. We’ve pioneered a memory-centric architecture that brings compute directly into memory, making AI faster, more energy efficient, and accessible on a global…

Sciforium

Open 116d On-siteNorth AmericaFull-timeLead

Lead Software Engineer, Model Serving Platform

AI API Containerization C++ CUDA +10 skills

Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with…

Vivix AI

多模态模型量化/稀疏工程师

AI CUDA GPU ONNX Python +5 skills

职位概述我们正在寻找一位多模态模型量化/稀疏工程师，负责视频生成、流式实时视频生成及多模态交互大模型的压缩与优化。你将围绕模型质量、推理延迟、显存与成本，推动量化和稀疏方案从算法验证走向规模化部署。核心职责 1. 量化与稀疏算法设计并落地后训练量化（PTQ）、量化感知训练（QAT）、混合精度及结构化/非结构化稀疏方案，推动 FP8、INT8、INT4 等低精度方案上线。针对…

TalentCloud Group

AI API CUDA Docker Embeddings +10 skills

AI Engineer

Open 72d EuropeFull-time

Switzerland

Build and optimize a locally hosted AI platform, deploying and running GPU-powered models, tuning inference pipelines, and integrating AI into internal tools.

Apple

Open 75d Europe, North AmericaSenior

Sr. Machine Learning Engineer, Foundation Models Inference - Cloud OS & Inference

Builds and optimizes inference stacks for large-scale Apple foundation models, enabling AI features across services like Siri and Photos with low latency.

AI AWS Cloud C++ CUDA +18 skills

recruitingfromscratch

On-siteNorth AmericaFull-time

Machine Learning Systems Engineer

AI Automation AWS Azure Cloud +19 skills

Who is Recruiting from Scratch: Recruiting from Scratch is a premier talent firm that focuses on placing the best product managers, software, and hardware talent at innovative companies. Our team is 100% remote and we…

Li Auto

高级存储研发专家（AI 训练数据缓存加速方向）

APACSenior

AI C++ Go GPU Linux +5 skills

1.主导设计和研发下一代分布式多级分层缓存加速系统，基于 GPU 主机本地内存、NVMe SSD、远端并行文件系统构建大容量弹性扩缩容的多级缓存架构，实现数据按需与透明加速； 2.参与设计和研发百 PB 规模的分布式文件缓存系统，支撑自动驾驶、大语言模型等业务的大规模分布式 AI 训练集群； 3.设计并实现智能数据放置与生命周期管理策略（如基于访问热度的分层调度、TTL/LRU 淘汰、预取优化），降低 GPU 因存储 I/O…

Memwize

Open 55d On-siteNorth AmericaPrincipal

Sr/ Principal Machine Learning Engineer — Inference Frameworks

AI Machine Learning PyTorch SGLang vLLM

Memwize is a VC-backed, stealth-mode startup building rack-level AI inference systems . We are seeking an experienced Senior/Principal Machine Learning Engineer to drive performance improvements in inference frameworks…

XSKY Data Technology

AI Infra 系统研发工程师

AI CI/CD C++ CUDA Go +7 skills

业务方向： 1、开发高性推理引擎及相关核心组件，根据硬件特性和 AI 模型的特点，不断迭代和完善，持续提升推理性能。 2、开发分布式 KVCache 存储组件，负责 KVCache 生命周期管理，包括显存、内存、SSD 的分层和缓存策略优化。 3、分析和优化推理阶段的性能瓶颈，进行系统级调优，建设并完善性能剖析和优化工具链，沉淀性能优化方法论。工作范式：我们正在打造一个 AI-Native（原生 AI）的研发环境，将 AI…

Sanas

Member of Technical Staff, LLM Post-Training, Applied

Open 70d North America

Agentic AI AI Data Quality Fine Tuning GPU +9 skills

About the Role Sanas is looking for a Member of Technical Staff to lead the post-training and deployment of large language models across a new generation of self-hosted, sovereign-deployed products. This is a rare…

ByteDance

Software Engineer Graduate (AML-Engine-Orchestration) - 2027 Start (PhD)

North AmericaJunior