freehire launches on Product Hunt on 26 August.

Follow →

Senior Software Engineer, AI Platform – US

Summary

Develops and maintains core AI platform components like agent loops, tool execution, and evaluation systems in Python, Postgres, and GCP, ensuring reliability, observability, and compliance for production-facing LLM integrations.


  • Core runtime surfaces of syndi-api: the agent loop, tool execution and registry, memory, context management (Python, Postgres, Claude on Vertex, GCP).

  • The eval system — offline gates and online detector/judge evals written onto production traces — and its growth as product teams adopt it.

  • Production operation: observability (Datadog LLM Obs), incident response, the reliability of an agent surface real customers use.

  • The platform's contribution seams: reviewing product teams' tool wrappers and evals, evolving the GET /tools registry and drift-detection contract.

  • Clarifying, designing, and implementing compliance and legal requirements for Syndi.


Requirements



  • 5+ years building production backend systems; deep comfort with Python, relational stores, and cloud infra (we're on GCP/Kubernetes).

  • You've built LLM-powered systems in production — an agent loop, tool-calling integration, RAG, or eval infrastructure — and have opinions from the scar tissue.

  • You design for operability: legal compliance, tracing, evals, and kill switches are part of the feature, not afterthoughts.

  • You can own a technical domain with light supervision: propose direction in writing with clear API specs, take review, ship, and carry the pager for what you shipped.

  • Strong written communication — our operating model runs on design docs and PR review across team boundaries.

  • Nice to have: experience being the platform side of a platform/product relationship; SSE/streaming systems; compliance-adjacent engineering (data minimization, auditability); prior Staff scope.


Core Competencies


Demonstrates expertise in building production backend systems with a focus on Python, GCP, and compliance requirements. Capable of designing operable systems that integrate LLM technologies and ensure reliability and observability.


Highest-signal resume keywords



  • Python Development

  • GCP Infrastructure

  • LLM-Powered Systems

  • Production Backend Systems

  • Strong Written Communication


ATS Optimization Keywords


Hard Skills



  • Python

  • Relational Databases

  • Cloud Infrastructure

  • Kubernetes

  • LLM Integration

  • API Design

  • Incident Response

  • Compliance Engineering

  • Tracing

  • Eval Infrastructure


Soft Skills



  • Strong Written Communication

  • Collaboration


Industry Keywords



  • Compliance

  • Observability

  • Incident Response

  • Data Minimization

  • Auditability


Tools & Technologies



  • Postgres

  • Datadog

  • Syndi-API

  • Claude on Vertex

See also

Tailor your CV for this role?

We couldn't check your fit for this role — add a CV to your profile to see it next time.

A new version of freehire is available