Principal Software Engineer
Posted Updated
Description
- As Principal Software Engineer, you are the senior technical voice for Enterprise AI. You own its architecture together with the teams that share the platform, and set the technical bar for a small, senior, remote-first team
- Own the architecture across the AI gateway, control plane, model serving, identity, metering and observability, for hosted and installed editions
- Lead the gateway strategy, including the data plane choice and policy-based routing with per-request metering and audit records
- Set direction for LLM serving on Kubernetes: GPU scheduling and sharing, autoscaling, multi-tenant and disaggregated serving, and cost per token
- Define how enterprises run the product: Helm installs and upgrades, air-gapped networks, preflight checks and supply-chain security
- Run design reviews, make build vs. buy calls, and record decisions as ADRs
- Build hands-on in the critical path, and mentor senior engineers, including on AI-assisted development
- Work with design partners and customers, and represent Mirantis in the Kubernetes and ML-infrastructure communities
- Expert Go, strong Python, and solid CI/CD and infrastructure as code
- Leads through writing and influence, uses AI-assisted development tools fluently, and thrives with autonomy on a distributed team
- Shipped multi-service systems that enterprises run in production, including software they install themselves
- 10+ years in infrastructure or distributed systems, including several as technical lead
- Expert Kubernetes: operators, CRDs, scheduling, Helm, and debugging at scale
- Production experience with GPU workloads, LLM inference or AI gateways
- AI gateway or LLM routing: failover, rate limiting, token metering, policy enforcement
- Took a new product to its first enterprise customers
- Inference performance work: quantization, batching, KV-cache management, disaggregated prefill and decode
Skills
Sign in to read and join the discussion.