AI Engineer
Posted Updated 18
views
Summary
The AI Engineer at Noma Security builds and maintains LLM-powered agents and MCP servers, focusing on evaluation frameworks, production deployment, and backend service design. The role involves hardening AI systems, managing integrations, and ensuring reliability through rigorous testing and monitoring.
- Build LLM-powered agents
- Build custom MCP servers
- Build evaluation frameworks and test sets
- Create integrations using REST APIs
- Deploy and monitor agents in production
- Design backend services for internal teams
- Develop automation pipelines
- Gather feedback and iterate on internal AI systems
- Harden and maintain MCP gateway ecosystem
- Implement authentication and secrets management
- Improve reliability and error handling
- Measure accuracy precision recall hallucination rates
- Partner with AI product manager on workflows
- Troubleshoot failures across integrations models APIs
Perks/Benefits:
- Dinners provided
- Dog-friendly office
- Fully stocked kitchen
- Global teams
- Happy hours
- Holiday gifts
- Monthly lunch budget
- Pilates classes
- Team retreats