AI Platform Engineer
Description
Role Summary:
The AI Platform Engineer is a hands-on software engineer who designs, builds, and operates the secure, scalable, governed foundation used by teams to develop and run enterprise AI applications and agents. The engineer builds and operates production-quality platform software and reusable services that support multiple business-facing products. These services may include approved model access, AI gateways, orchestration runtimes, identity and policy enforcement, evaluation, observability, deployment automation, and cost controls.
This is a hands-on software engineering role spanning platform services, APIs, distributed systems, cloud infrastructure, DevSecOps, reliability, and generative AI. The primary hiring bar is demonstrated ability to design, code, test, review, deploy, and support production systems. The engineer turns enterprise architecture and governance requirements into reusable platform capabilities and standardized engineering paths that allow development teams to move quickly without recreating security, integration, monitoring, or operational controls for every solution.
Responsibilities:
-
Design, code, test, deploy, and operate shared enterprise AI platform services that are secure, scalable, resilient, observable, and easy for development teams to consume.
-
Write maintainable, production-quality software for platform APIs, control-plane services, data and event-processing components, SDKs, libraries, and developer tooling.
-
Make sound software-architecture decisions covering service boundaries, interfaces, data models, concurrency, failure handling, performance, scalability, and backward compatibility.
-
Implement governed access to approved foundation models and providers through gateways, APIs, SDKs, routing, quotas, authentication, authorization, and policy controls.
-
Develop platform APIs, services, libraries, command-line tools, templates, and reference implementations using languages such as Python, TypeScript, or Java.
-
Integrate identity, SSO, service identities, RBAC/ABAC, secrets management, network controls, data-protection controls, and audit logging into platform services.
-
Build automated unit, integration, security, performance, resilience, and platform-acceptance tests.
-
Create developer documentation, onboarding flows, sample applications, runbooks, reference architectures, and reusable engineering standards.
-
Evaluate emerging models, frameworks, runtimes, gateways, and AI infrastructure against enterprise requirements and concrete engineering use cases.
-
Partner with product and application teams to improve developer experience while maintaining clear ownership boundaries between platform and product teams.
-
Develop and review platform code, infrastructure-as-code, APIs, libraries, deployment pipelines, policies, automated tests, and operational tooling.
-
Work with architects, security, identity, cloud, data, and application teams to turn requirements into reusable platform capabilities.
-
Acts as an informal technical leader by setting platform engineering standards, reviewing designs and code, and mentoring engineers.
-
May lead the delivery of a shared platform capability or coordinate technical work across cloud, security, data, and application engineering teams.
Required Qualifications:
-
Bachelor’s degree in Computer Science, Software engineering, Cloud engineering, Information systems, Data engineering, Artificial intelligence, or a related technical field
-
Experience in either of these: relevant cloud, Kubernetes, DevOps, SRE, security, data, or AI certifications
-
6+ years of professional software engineering experience with demonstrated hands-on development of production services, APIs, or distributed systems.
-
Demonstrated experience designing, coding, testing, deploying, and operating shared production services used by multiple applications or development teams.
-
Hands-on proficiency with Python and at least one additional language such as TypeScript/Node.js, or Java.
Preferred Qualifications:
-
Experience applying software-engineering fundamentals including modular design, data structures, concurrency, error handling, code review, automated testing, versioning, and maintainability.
-
Experience with at least one major cloud platform and technologies such as containers, Kubernetes, serverless services, API gateways, queues, databases, caches, and secrets management.
-
Hands-on experience building production agentic or LLM systems using an orchestration framework such as LangGraph, Google Agent Development Kit (ADK), Semantic Kernel, or an equivalent technology.
-
Experience with Git, CI/CD, infrastructure as code, automated testing, observability, security controls, and production incident response.
-
Practical experience integrating LLM providers or building LLM-powered platform capabilities such as gateways, RAG services, agent runtimes, evaluations, guardrails, or monitoring.
-
Experience working with enterprise security, architecture, data, identity, privacy, or governance teams.
Skills
- ABAC
- Agentic AI
- AI
- API
- Authentication
- Automation
- CI/CD
- Cloud
- Data Engineering
- Developer Experience
- DevOps
- DevSecOps
- Distributed Systems
- Generative AI
- Git
- Infrastructure as Code
- Java
- Kubernetes
- LangGraph
- LLM
- Node.js
- Observability
- Python
- RBAC
- Secrets Management
- Semantic Kernel
- Serverless
- SRE
- SSO
- Test Automation
- TypeScript