Tech jobs
Job listings
Software Engineer - Training/Inference (C++)
You will design and optimize large-scale model-serving systems from distributed infrastructure through low-level GPU optimizations. You will improve inference latency, throughput, reliability, deployment, and testing…
Staff Applied AI Inference Engineer
Crusoe is on a mission to accelerate the abundance of energy and intelligence . As the only vertically integrated AI infrastructure company built from the ground up, we own and operate each layer of the stack — from…
Sr. Software Engineer - AI Triton Communication
Build and optimize Triton’s distributed GPU communication and execution stack for AMD Instinct accelerators, enabling scalable multi-GPU AI training and inference.
AI Field Engineer - AI Natives
Who is Recruiting from Scratch: Recruiting from Scratch is a premier talent firm that focuses on placing the best product managers, software, and hardware talent at innovative companies. Our team is 100% remote and we…
Staff Technical Program Manager, Deployments
United States | Hybrid or Remote | Full-time The role You'll work directly with Evergrid's customers to architect, build, and deploy high-scale production inference systems on our infrastructure. You own customer…
Research Engineer - Model Evaluation & MLOps
Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with…
Staff Software Engineer, AI Platform
Architect and build the distributed platform that powers AI agents in production, including orchestration, memory, tool calling, and workflow coordination for enterprise environments.
Research Intern (Inference Infrastructure) - 2027 Start (PhD)
About the Team The Inference Infrastructure team is the creator and open-source maintainer of AIBrix, a Kubernetes-native control plane for large-scale LLM inference. We are part of ByteDance’s Core Compute…
Research Intern (AI Compute) - 2027 Start (PhD)
About the Team The Inference Infrastructure team is the creator and open-source maintainer of AIBrix, a Kubernetes-native control plane for large-scale LLM inference. We are part of ByteDance’s Core Compute…
Research Intern (AI Compute) - 2027 Start (PhD)
About the Team The ByteDance DPU (Data Processing Unit) team builds foundational cloud and AI computing infrastructure for ByteDance and Volcano Engine. Our mission is to advance the architecture, development, and…
Technical Program Manager, Model Performance
Zero-to-one Technical Program Manager for Baseten's Model Performance team, building planning structures and driving execution of inference optimization and model release programs across cross-functional engineering teams.
云端推理优化架构师（数据算子infra）
1、负责数据算子 Infra 的架构设计与建设，支撑文本、图像、音频、视频数据的清洗、理解、标注、筛选与转换。 2、负责小模型及 VLM/LLM 的部署与推理优化，涵盖 ONNX、TensorRT、低精度量化、批量推理、显存管理和并发调度。 3、建设高性能推理服务，优化模型管理、动态批处理、请求路由、背压，以及 gRPC、HTTP、brpc 通信链路。 4、优化基于 FFmpeg、NVCodec 的 GPU…
Founding Senior AI Infrastructure Engineer
About us We’re building toward a world where every company can become its own AI lab. Goaly is a stealth AI startup founded by ex-Meta MSL engineers and researchers. Our mission is to dramatically lower the cost, time,…