Software Engineer Inference Platform
Posted 6
views
Summary
Cerebras is hiring a software engineer for its AI inference platform: designing, building, and operating highly available, latency-sensitive Kubernetes-based services and improving failover, observability, security, throughput, and capacity efficiency, with production coding in Go or C++.
You will design, develop, test, and maintain production software for an inference orchestration platform. You will improve availability, failover, observability, security, latency, throughput, capacity efficiency, incident response, and scalable system design.
Responsibilities
- Design, develop, test, and maintain production software
- Help define platform direction, Kubernetes custom resource definitions, failure domains, and service boundaries
- Architect active-active systems with failover, graceful degradation, and service-level objectives
- Improve latency, throughput, capacity efficiency, and resilience
- Write and review production code for critical platform paths
- Drive observability, incident response, capacity planning, and post-incident improvements
- Translate requirements into scalable system designs with cross-functional partners
Requirements
- 3+ years of software engineering experience
- Large-scale distributed systems or cloud infrastructure
- Kubernetes
- Highly available latency-sensitive systems
- Security
- Certificates
- TLS
- mTLS
- High-QPS system optimization
- Go or C++