Senior Site Reliability Engineer
Posted Updated
Description
- As a Senior Site Reliability Engineer, you will manage and scale the Devops platform
- Your job is to make it more resilient, faster to build on and safer to change as the robot fleet and the engineering team grow
- You own your work end to end, from architecture decisions down to the Linux kernel, the network and the disk when something misbehaves
- We are looking for a hands-on engineer who builds systems that are reliable by design and keeps digging until they understand why something broke
- Manage and scale our Kubernetes platform on bare metal, virtual machines and public cloud, including cluster provisioning, networking, storage and upgrades
- Build the CI/CD infrastructure our robotics engineers ship with: build runners, remote build execution and caching, container registries, and autoscaling that adds capacity on-prem or in the cloud as demand changes
- Design for failure: backups, multi-site recovery, and recovery drills that prove the company keeps working when a data center goes down
- Make change safe with GitOps delivery, progressive rollouts, and automatic rollback when a release fails its health checks
- Decide what to measure. Define SLIs and SLOs for the platform, and build the monitoring and alerting around them
- Debug production issues across the stack, from Kubernetes down to the Linux kernel, the network and the disk, and fix the root cause so they do not come back
- Manage infrastructure as code with tools such as Terraform, Helm and Ansible, and write tooling in Go or Python to remove manual work
- Build security into the platform: single sign-on and role-based access, certificate and secret management, and minimal, patched operating systems
- Partner with robotics software teams on architecture and production readiness, and set the standards other teams build on
- Plan capacity and cost across on-prem and cloud as the robot fleet and the engineering team grow
- Software skills in Go or Python. You build tools and services, not only scripts
- Hands-on debugging: you work in a shell and reach for tools such as strace, tcpdump, ss and perf
- Observability: you know what to measure, how to alert on it, and how to set SLOs
- A record of building infrastructure from scratch and running it reliably in production
- You prioritize well, work independently, and finish what you start
- Infrastructure as code and GitOps with tools such as Terraform, Ansible, Helm and Argo CD
- Kubernetes in production: you have built clusters, upgraded them, and debugged them when networking, storage or scheduling broke
- Networking: TCP/IP, DNS, TLS, load balancing, VLANs and BGP
- Linux: deep knowledge of operating system internals, the networking stack, file systems, process and resource management, and performance tuning
- You design for failure, and ask how a system will break before you build it
- Bachelor’s degree in Computer Science, Computer Engineering, or a related field, or equivalent practical experience
- You keep digging until you can explain the root cause, and you stay clear-headed during an outage
- 5+ years of relevant experience in Site Reliability Engineering, DevOps, or Infrastructure Engineering with a focus on hybrid cloud environments
- Experience planning disaster recovery and running recovery drills
- Experience running infrastructure on both x86_64 and ARM
- Experience with infrastructure for robotics, embedded systems or IoT device fleets
- Experience operating container registries with replication and caching across sites
- Experience with immutable, API-managed operating systems for Kubernetes nodes, and with eBPF-based networking
- Experience building and operating CI/CD and build infrastructure at scale, such as remote build execution and caching, container build optimization and runner autoscaling
- Hybrid infrastructure: on-prem bare metal, virtualization and SAN or NAS storage, and at least one public cloud
Skills
Sign in to read and join the discussion.