Senior Site Reliability Engineer (AWS & AI Infrastructure)
Summary
Senior SRE owning the reliability, scalability, security and cost of an AWS-based platform that powers production AI agents and LLM-driven enterprise products — building infra with Terraform, Kubernetes/ECS, CI/CD and observability. Onsite in New York City 5 days/week; base salary up to $225,000.
Senior Site Reliability Engineer (AWS & AI Infrastructure)
Location: New York City (5 days onsite)
Salary: Up to $225,000 base
Employment: Full-time
The Opportunity
Having recently made a successful placement with this client, we're delighted to be continuing our partnership and working directly with their founding team on a number of exciting new hires.
Our client is an innovative AI-native technology company transforming how some of the world's largest enterprises operate through advanced AI agents and intelligent automation.
Originally backed by Y Combinator and subsequently acquired by a major enterprise software organisation, the business combines the speed, autonomy and technical ambition of an early-stage startup with the resources and enterprise reach of a global technology leader.
They're now looking for a talented Senior Site Reliability Engineer (AWS & AI Infrastructure) to help build, scale and maintain the cloud infrastructure powering their next generation of AI-driven enterprise products.
This is an opportunity for an infrastructure engineer who enjoys building rather than simply maintaining systems, thrives in fast-moving environments and wants to work at the intersection of cloud engineering, distributed systems and production AI.
The Role
Working closely with the founding team and software engineers, you'll take ownership of the reliability, scalability, security and performance of a modern AWS-based platform supporting AI-powered applications and agentic workflows.
You'll play a central role in designing infrastructure that enables engineers to deploy quickly, experiment confidently and operate complex AI systems at enterprise scale.
Key responsibilities:
- Design, build and maintain highly available, scalable and secure cloud infrastructure within AWS.
- Develop and optimise infrastructure supporting production AI applications, LLM integrations and agent-based systems.
- Build and improve CI/CD pipelines, infrastructure automation and deployment processes.
- Implement Infrastructure as Code using Terraform or similar technologies.
- Manage containerised workloads and orchestration platforms such as Docker, Kubernetes or AWS ECS/EKS.
- Establish robust monitoring, logging, alerting and observability across cloud infrastructure and AI workloads.
- Improve platform reliability, system performance, incident response and disaster recovery capabilities.
- Collaborate with engineering teams to improve deployment velocity and developer productivity.
- Optimise infrastructure costs, resource utilisation and performance as AI workloads scale.
- Help establish engineering best practices around security, automation, reliability and operational excellence.
What We're Looking For
- Strong professional experience in Site Reliability Engineering, DevOps, Platform Engineering or Cloud Infrastructure Engineering.
- Deep hands-on AWS expertise, including designing and operating production cloud environments.
- Experience supporting AI/ML applications, LLM-powered products or other compute-intensive production workloads.
- Strong Infrastructure as Code experience, ideally Terraform.
- Experience with Docker and container orchestration technologies such as Kubernetes or ECS.
- Proficiency in Python, Bash or another scripting language for infrastructure automation.
- Experience building and maintaining CI/CD pipelines.
- Strong understanding of cloud networking, security, IAM, observability and distributed systems.
- Experience troubleshooting complex production environments and improving platform reliability.
- A proactive, highly autonomous engineering mindset with a strong sense of ownership.
- Comfortable working directly with software engineers and making technical decisions in a fast-moving environment.
- Able to work onsite in New York City five days per week.
Desirable experience:
- Experience deploying and operating LLM-based applications or agentic AI systems in production.
- Familiarity with AI inference infrastructure, model-serving architectures or GPU-based workloads.
- Experience with AWS AI/ML services such as Bedrock or SageMaker.
- Experience with observability platforms such as Datadog, Prometheus, Grafana or OpenTelemetry.
- Previous experience in an early-stage startup or high-growth technology business.
- Exposure to enterprise SaaS environments with demanding security, reliability and availability requirements.
Why Join?
- Excellent compensation: Base salary up to $225,000.
- Cutting-edge AI: Work on infrastructure supporting real-world AI agents and enterprise AI applications.
- Technical ownership: Take responsibility for critical infrastructure and influence architectural decisions.
- Startup environment, enterprise backing: Enjoy the pace and autonomy of a startup with the resources of an established global software organisation.
- Direct founder access: Work alongside experienced technical founders and a highly capable engineering team.
- Meaningful engineering challenges: Help solve complex infrastructure problems as AI products scale across enterprise customers.
- Career progression: Join at a stage where your technical contributions will have a direct impact on the platform's future.
Interested?
If you're an experienced AWS-focused SRE or Platform Engineer with a genuine interest in AI infrastructure and building reliable systems at scale, we'd love to hear from you.
Apply today or contact Oxbow Talent for a confidential discussion.
Skills
Sign in to read and join the discussion.