Senior AI Infrastructure Engineer - High Performance Compute
Summary
Senior engineer who architects and operates a greenfield, large-scale GPU cloud (H100/A100/L40S) serving AI inference and real-time rendering customers: bare-metal GPU deployment and virtualization, CUDA/driver tuning, InfiniBand/RoCE networking, plus Kubernetes-based provisioning, monitoring, and multi-tenancy automation.
Confidential | AI & High-Performance Compute Platform. Our client is now powering the next wave of AI inference and real-time rendering workloads on their own GPU cloud.
Why This Role Is Exciting:
This is a GREENFIELD GPU cloud build. You will not just maintain GPUs, you will architect how thousands of GPUs are deployed, virtualized, and delivered as a service for AI customers. High demand, cutting-edge stack (H100, A100, L40S), zero legacy.
What You Will Own:
- Architect, deploy, and operate large-scale GPU infrastructure — bare metal + orchestration
- Optimize GPU performance, drivers, CUDA, networking (InfiniBand, RoCE), and virtualization
- Build automation for GPU provisioning, monitoring, and multi-tenancy
- Support AI / ML customers with high-performance GPU workloads
Who You Are:
- 4+ years with GPU Systems / HPC / AI Infrastructure
- Hands-on with NVIDIA GPUs, CUDA, driver stack, GPU operator, Kubernetes
- Strong Linux and networking fundamentals, experience with high-performance fabrics
- Bonus: Experience with GPU cloud providers, CoreWeave / Lambda / Vultr style platforms