Senior Production Engineer (Storage)
Posted Updated
Description
- At Crusoe Energy Systems, our Site Reliability Engineering (SRE) team plays a mission-critical role in maintaining the performance and reliability of our AI-optimized cloud infrastructure
- The Storage-focused SRE role is responsible for ensuring the availability, performance, and scalability of Crusoe’s cloud storage products and services, which power compute-intensive, latency-sensitive workloads for AI and HPC use cases
- This role directly supports our vertically integrated, sustainable cloud platform by building and optimizing distributed, fault-tolerant storage systems at scale
- In this role, you will build automation and self-healing tools to monitor and maintain Crusoe’s distributed cloud storage infrastructure, which includes block, file, and object storage systems
- You will drive reliability initiatives focused on data replication, encryption, backup and restore strategies, and robust failover mechanisms
- Collaborating closely with storage engineers, you will help implement and maintain high-performance NVMe- and SSD-backed volumes that support large-scale AI compute clusters
- Your responsibilities will also include supporting user-facing storage services with a focus on availability, performance tuning, and adherence to error budgets
- You’ll investigate and resolve storage-related incidents using deep telemetry, logs, and performance profiling, while also partnering with hardware and kernel teams to diagnose low-level I/O issues and optimize I/O paths, cache policies, and file systems
- Additionally, you will contribute to the architecture of fault-tolerant, scalable storage backends tailored for AI-first cloud environments
Benefits
- Health & wellbeing: Comprehensive health benefits designed to support your overall wellness
- Time away: Paid time off for vacations, family bonding, and unexpected needs
- 401(k) match: Build your financial future with our 401(k) matching program
- Mental wellness: Resources and support for your emotional wellbeing and navigating life’s challenges
- 5+ years of professional experience in Storage SRE, systems, or storage engineering
- Bachelor’s degree in Computer Science, Electrical Engineering, or a related technical field, or equivalent practical experience
- Strong experience working with containerized workloads and orchestration platforms (e.g., Kubernetes, Docker)
- Deep understanding of object, block, and file storage paradigms
- Experience with Infrastructure as Code and deployment tooling such as Terraform, Ansible, or Puppet
- Deep, hands-on experience with enterprise storage platforms such as Pure Storage or EMC — not limited to volume creation/provisioning, but a working understanding of how the systems are architected and operated
- Excellent incident response, troubleshooting, and documentation practices
- Deep knowledge of Linux internals with a focus on I/O subsystems, memory management, and storage scheduling
- Proficiency in a programming language such as Go, Python, Java, or C
- Familiarity with storage protocols like NFS, SMB, iSCSI, or NVMe-oF
- Experience with building and operating managed services at scale such as object, file and block storage (AWS, GCP, Azure)
- Hands-on experience with distributed storage systems (e.g., Ceph, GlusterFS, OpenEBS, Vast, Lightbits)
- Contributions to open-source storage projects or the Linux storage stack
- Experience with hybrid storage models across on-prem and cloud environments