Senior Forward Deployed Engineer, ML Infrastructure & Inference
Posted Updated
Description
You will build custom endpoints and pipelines on top of FLUX for customers and take use cases from scoping through proof of concept to production. You will own deployment of FLUX models into customer environments, from on premise to BFL-hosted, profile workloads to hit cost and latency targets, build evaluation harnesses, help customers with finetuning and LoRA training, advise on architecture trade-offs, and mentor other engineers.
Responsibilities
- Build custom endpoints and pipelines on top of FLUX for customers
- Take customer use cases from scoping to proof of concept to production endpoint
- Own deployment of FLUX models and custom pipelines into customers' production environments including serving setup, GPU sizing and scaling
- Profile customer workloads and apply inference optimizations to hit cost and latency targets
- Build evaluation sets and harnesses and catch quality regressions across model versions
- Help customers adapt models through finetuning and LoRA training pipelines
- Advise customers on deployment architecture and hosted vs self-hosted trade-offs
- Feed field learnings back to research and platform teams and build reusable tooling, reference architectures and documentation
- Set standards and mentor other engineers as a technical thought leader
Requirements
- 6+ years of engineering experience with significant time building and running ML systems in production
- Hands-on experience building and serving ML models in production (PyTorch, model serving frameworks, GPU workloads)
- Experience building applied ML systems end to end
- Solid infrastructure skills: Kubernetes, containerization, observability, and a major cloud platform (AWS, GCP, Azure)
- Experience working directly with customer engineering teams in enterprise environments, including security reviews and regulated or air-gapped setups
- Strong Python skills
- Ability to explain complex technical trade-offs to engineers and non-technical stakeholders
- Willingness to take on Technical Deployment Lead responsibility
- Willingness to travel occasionally
Benefits
- Equity
Skills
Sign in to read and join the discussion.