Engineering Manager (Runtime - Storage)
Posted Updated
Description
- As Engineering Manager for Storage Products on the Runtime Fabric team, you will lead the engineers who build and run the storage products behind that stack: the Baseten Delivery Network (BDN), which sits in the cold start path of every model on the platform, the snapshotters and filesystems that expose model weights and container images to a running container, and the storage that model deployment and training need next
- The team is advancing the next generation of caching for inference workloads, from the origin tier to the GPU host
- You will own reliability for the area as a measured outcome, report to the head of Runtime Fabric, and stay close to the code through design and code review
- If you’ve managed systems engineers and have hands-on experience with caching, content-addressable storage, or distributed filesystems, we’d love to talk
- Team Leadership and Culture
- Hire and grow a team of 5 to 10 systems engineers with storage, caching, and Linux expertise
- Run the team’s planning and delivery: scope work against the Runtime Fabric roadmap, set priorities, and ship on a predictable cadence
- Provide regular coaching, feedback, and career development support to your direct reports
- Own on-call health for the team’s services, including escalation paths and follow-through on incidents
- Technical Direction
- Guide the architecture and evolution of the Baseten Delivery Network: the tiered caching and weight delivery product that makes cold starts 2-3x faster and eliminates thundering herd failures during burst scaling events
- Shape storage products tailored to Baseten’s workloads: extend BDN from model weights to container images, training checkpoints, and deployment artifacts, and define the interfaces that model deployment, training, and customers use to reach them
- Oversee the on-host side of delivery: lazy-loading snapshotters, EROFS and overlayfs layouts, and block-level delivery (FUSE, ublk) for multi-gigabyte files
- Own reliability of the delivery path as a measured outcome: end-to-end instrumentation from snapshotter initialization to first inference request, targets for cold start and cache behavior, tolerance for failing upstream registries and object stores, and safe rollout of changes to a path every customer depends on
- Make the delivery path work across heterogeneous clusters and cloud providers, each with its own object store and network
- Review designs and code across the area, and take on hands-on work where it unblocks the team
- Champion the team’s contributions back to containerd and the snapshotter ecosystem alongside the maintainers on the Runtime Fabric team
- Cross-Functional Partnership
- Act as the point of contact for storage across Baseten, ensuring model deployment, training, and platform teams have the integration support they need
- Optimize requirements for the underlying storage platforms with the infrastructure team: object storage, local NVMe and block storage, and network bandwidth per cluster, so that capacity and provider decisions account for what the delivery path needs
- Manage the team’s dependencies in both directions: sequence work that model deployment, training, and infrastructure teams block on, and negotiate interfaces and timelines with the teams and upstream projects the storage path depends on
- Work with the head of Runtime Fabric and product stakeholders to prioritize storage investments based on customer impact and infrastructure reliability
- Communicate team progress, technical trade-offs, and incidents clearly to the team and to leadership
Benefits
- Remote-first work environment. The Baseten team is welcome to work from wherever they want; fully remote, in our San Francisco office, or a mix of both. Today, our team (including our founding team) is spread across the United States, Canada, and Armenia. We provide a $1,000 stipend for you to make your home-office comfortable and productive
- Regular in-person team summits. We get together as a team three times a year to plan, workshop, and most importantly, get to know each other better
- Unlimited PTO. We ask that everyone take at least 4 weeks of vacation. And we have a company-wide break between Christmas and New Year’s Day
- Full healthcare coverage. Medical, dental and vision insurance for you and your family
- Paid parental leave. 16-weeks fully paid parental leave (adoptive and non-birth parents included) and flexibility with schedules while returning to work
- Company-sponsored 401(k) for you to contribute to
- Learning and development budget. We encourage you to take classes, attend conferences, and invest in your craft and we’ll cover expenses to make it happen
- Strong written and verbal communication skills, with the ability to influence without authority across teams
- Experience managing a team of engineers in a systems, infrastructure, or storage context, including hiring and performance management [TODO: confirm whether a tech lead stepping into management qualifies]
- Understanding of how container images are structured, stored, and delivered at scale
- Hands-on background in distributed storage systems, content-addressable storage, or large-scale caching infrastructure
- Working knowledge of the Linux storage stack: filesystems, the page cache, block devices, and mounts
- Strong systems programming background in Go, Rust, and/or C/C++, with the ability to engage credibly in code reviews and architectural discussions
- Contributions to containerd/containerd, snapshotter projects (stargz, soci, nydus, overlaybd), distribution/distribution, or closely related open-source projects
- Familiarity with lazy-loading snapshotters or peer-to-peer image distribution
- Experience with EROFS, FUSE, ublk, or io_uring
- Experience building or operating CDN, object storage, or large-scale caching infrastructure
- Experience running storage services on Kubernetes
Skills
Sign in to read and join the discussion.