Senior Cloud Infra Engineer - AWS & LLM Platform (Hybrid)
Posted Updated
Description
Beacon AI seeks Senior Software Engineers, Cloud Infrastructure to build and operate a scalable AWS foundation and LLM platform. You will design, implement, and run services that power retrieval-augmented generation and IoT workflows, with heavy emphasis on reliability and security.
The role is hybrid, based in San Carlos, CA, with opportunities to optimize ML pipelines and observability while working with a talented team of aviators and engineers.
Design and maintain AWS infrastructure using CDK or Terraform. Build CI/CD and testing for apps, infra, and ML pipelines. Operate secure networking with VPCs, PrivateLink, and IAM/KMS management. Stand up model endpoints using Bedrock or SageMaker and manage inference workloads. Develop LLM-enabled services with clean API surfaces and robust error handling. Implement prompt/tool flows with LangChain and function calling. Design and run RAG data pipelines and vector search with OpenSearch or Pinecone. Coordinate data ingestion/processing with Glue, Lake Formation, and Athena. Ensure observability, cost governance, and performance optimizations. Collaborate with product/engineering to integrate retrieval services. Proven experience designing and operating AWS infrastructure at scale. Hands-on with IaC and CI/CD pipelines for ML apps. Strong understanding of security, IAM, KMS, and audit logging. Experience with LLM platforms, retrieval-augmented generation, and LangChain. Familiarity with data pipelines, vector databases, and analytics services. Healthcare benefits 3 weeks PTO + holidays 401(k) planSkills
Sign in to read and join the discussion.