freehire launches on Product Hunt on 26 August.

Follow →

Principal AI Platform Engineer

Summary

Builds and maintains the AI platform infrastructure, including model gateways, vector databases, and LLM evaluation tools, to integrate GenAI insights into agent workflows and downstream applications.

Responsibilities

  • The Principal AI Platform Engineer will focus on building the infrastructure that connects AI systems with existing products and will enable seamless delivery of AI-generated insights into agent workflows
  • Design, build, and maintain the core infrastructure layer supporting GenAI products, including model gateways, prompt/versioning stores, vector databases, and LLM evaluation tools
  • Implement secure access controls and authentication mechanisms integrated by default into the AI platform components
  • Develop and manage observability, monitoring, and logging solutions for GenAI workloads and infrastructure
  • Collaborate closely with product and engineering teams to integrate GenAI infrastructure with agent frameworks, and downstream applications
  • Optimize infrastructure for scalability, high availability, cost efficiency for production workloads
  • This team will serve as the product owner for GenAI capabilities within PointClickCare, working closely with other engineering teams across the organization to identify, build and support generative AI solutions
  • This centralized team with deep specialization, closely integrated with key horizontal partners to ensure delivery of safe, scalable and high-impact AI Products

Qualifications

Extensive experience building and maintaining AI platform infrastructure, Kubernetes, and container security. Demonstrated expertise in observability, and monitoring frameworks, with a focus on real-time performance (i.e: experience with OpenTelemetry, MLFlow). Experience with AI infrastructure components such as vector databases, prompt/versioning stores, and AI IDEs. Experience with CI/CD pipelines and automation for AI model deployment and platform operations. Strong knowledge of authentication and authorization frameworks integrated into AI platforms. Familiarity with vLLM, SGLang or similar framework to host LLM inference workloads.

See also

Tailor your CV for this role?

We couldn't check your fit for this role — add a CV to your profile to see it next time.

A new version of freehire is available