AI Platform Engineer
Posted 5
views
Summary
Builds the internal AI platform at Instructure: designs REST/GraphQL APIs and domain services that abstract LLM usage for product teams, and runs the AWS infrastructure behind prompt management, context handling, auditing, and response processing. Also creates developer tooling, documentation, and best practices for LLM use.
- Design and implement APIs and domain services that abstract the complexity of using an LLM and enable rapid feature development from product teams
- Build scalable AWS infrastructure for LLM interactions, including prompt management, context handling, auditing, and response processing
- Create developer tooling and documentation that makes integration with services intuitive and easy
- Establish best practices for AI and LLM use considering auditability, cost, and performance
- Collaborate with feature teams to understand needs and solve them with platform capabilities
- Design, develop, and maintain scalable and performant APIs
- Write clean, maintainable, and well-documented code
- Participate in code reviews and provide and receive constructive feedback
- Prior software engineering experience with API design and distributed system development
- Strong experience building backend services and REST or GraphQL APIs
- Knowledge of API design best practices around security, performance monitoring, rate limiting, and more
- Understanding of LLM integration and usage patterns
- Strong collaboration and written and verbal communication skills
- Past experience with cloud infrastructure, preferably on AWS
- Experience with Node.js or a desire to learn
- Experience with TypeScript or a desire to learn
- Background in developer tooling and API documentation
- Competitive compensation
- Participation in ownership program for full-time employees
- Flexible work culture with remote, hybrid and in-office collaboration spaces
- Generous time off including local holidays and annual "Dim the Lights" period
- Comprehensive wellness programs and mental health support
- Learning and development resources including professional development tools and tuition reimbursement
- Technology and tools needed to do best work
- Motivosity employee recognition program
- A culture rooted in inclusivity, support, and meaningful connection