Senior AI Infrastructure Reliability Engineer
Posted Updated
Description
Firmus Technologies is seeking a Senior Platform Reliability Engineer to operate Firmus AI FactoryOS in production. You will own GPU compute fleet and platform services, including exabyte-scale storage and observability, ensuring 24/7 reliability and performance.
This hands-on role requires deep expertise in Linux, storage, virtualization, and automation. You will drive automation, runbooks, and incident response while coordinating with AI Infrastructure and site operations.
Operate multi-tenant control and management plane with tenant workloads and data separation. Manage exabyte-scale storage and S3-compatible object storage to service levels. Run GPU compute fleet in production with fault detection and remediation workflows. Build guarded automation and remediation tooling as code and runbooks. Tune performance across data paths and networks, using RDMA, InfiniBand, RoCE. Deliver changes as code and improve CI/CD, validation, and testing frameworks. Operate observability infrastructure as a service to provide actionable telemetry. Meet published service levels and manage patching and vulnerability remediation. Provide senior technical expertise, diagnose faults, and coordinate vendor escalations. Lead major incidents, participate in on-call, create runbooks and root-cause analyses. 8+ years in infrastructure, production storage and shared infra services in 24/7 environments. Experience with scale-out storage for demanding workloads and performance tuning. Experience operating virtualisation platforms and shared services to defined SLAs. Expert-level Linux knowledge: storage, kernel, networking and I/O subsystems. Experience with observability tooling and alerting that drives action. Infrastructure automation through code, with peer review and testing. Scripting for operational automation (Python/Go/Bash). Kubernetes proficiency to diagnose faults in containerized environments.Skills
Sign in to read and join the discussion.