Software Engineer – Platform Security
Summary
Hands-on security engineer role at FriendliAI to architect and build the security foundations of its multi-tenant, Kubernetes-based serverless AI inference platform — owning control/data plane security, Terraform/Helm guardrails, IAM, secrets management, runtime detections, and compliance automation.
About the job
FriendliAI is looking for an engineer to architect and build the security foundations of a multi-tenant serverless compute platform running on Kubernetes with hardened container isolation. As a Software Engineer, Platform Security, you will own the security design for both the control plane and data plane, implement guardrails as code, and partner closely with Platform/SRE/Infra teams to ship a secure-by-default developer experience. This is a hands-on builder and architect role.
Key Responsibilities
Design and implement the security architecture for a Kubernetes-based, multi-tenant serverless platform.
Build guardrails as code using Terraform and Helm.
Establish network segmentation and service-mesh policy.
Develop secrets and key management patterns.
Implement runtime detections for containerized workloads.
Design and roll out IAM & workload identity management.
Threat model new features and changes to the overall platform.
Collaborate with engineering to debug production issues, lead post-incident hardening, and automate evidence for compliance controls.
Qualifications
5+ years securing cloud-native platforms with a focus on distributed systems and multi-tenancy.
Bachelor’s or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent.
Strong hands-on experience with AWS (IAM, VPC/networking, logging/monitoring, …) and Kubernetes/container security.
Proficiency with Terraform and Helm.
Experience building or operating runtime detections for containers/functions.
Strong technical background in backend systems, cloud infrastructure, or AI tooling
Clear written and verbal communication; ability to translate pricing/business rules into robust systems.
Preferred Experience
Knative or similar serverless-on-K8s frameworks.
Container hardening and sandboxing.
Policy-as-code and admission policy design at scale.
eBPF-based observability, detections, and signal tuning.
Multi-cloud exposure and cross-cloud identity approaches.
Hands-on contributions to SOC 2 / HIPAA control automation and audit evidence pipelines.
Benefits
A front-row seat to the generative AI infrastructure revolution
Competitive compensation and benefits package
Daily lunch and dinner provided; unlimited snacks and beverages
Health check-up and top-tier hardware support
Flexible working hours and a highly collaborative environment
About us
FriendliAI is building the next-generation AI inference platform that accelerates the deployment of large language and multimodal models with unmatched performance and efficiency. Our infrastructure powers high-throughput, low-latency workloads for global organizations and integrates directly with Hugging Face, providing instant access to over 600,000 open-source models. We are on a mission to deliver the world’s best platform for AI inference.
Skills
As published by ashby · 6 questions
Basics
Name, Email, Resume, Location
Short answers (4)
- LinkedIn Profile
- Phone Number
- Current/Most Recent Company Name
- Current/Most Recent Jot Title
Pick from a list (2)
- This is a hybrid role and has an in-office requirement of 2-3 days in one of our office locations (San Mateo or Downtown SF). Are you comfortable commuting into the office to meet this requirement?
- Will you now or in the near future require visa sponsorship?



