Production AI Engineer - LLMs & Safe Deployments
Posted Updated
Description
Teamwill Consulting seeks an Applied AI Engineer to design, build, and operate production AI systems that combine managed LLMs with self-hosted models. You will develop pipelines, conduct retrieval and eval suites, and ensure safe, observable deployments in a regulated financial services context.
You’ll work across teams, partner with clients, and drive scalable AI assets from prototype to client-ready solutions, focusing on cost, performance, and governance under strict data constraints.
Design, build, test, and operate AI systems that call LLMs to perform multi-step tasks and meet nonfunctional requirements. Start simple, then evolve to autonomous agent designs with lightweight, provider-agnostic integration. Integrate managed and self-hosted models, including inference tuning under GPU constraints. Build and maintain retrieval pipelines grounding models in knowledge bases (RAG). Develop eval suites to gate changes before production and implement guardrails for safety and cost. Package AI components as containerized services with documented interfaces. Collaborate with clients and engineers to move assets from prototype to client-ready deployments. Master’s degree (or equivalent) in computer science, applied mathematics, or related engineering discipline. 3+ years of hands-on software engineering experience, including production systems that integrate large language models or ML models. Strong Python skills, plus experience reading/writing another language (e.g., TypeScript or Java) and API integration with model providers. Experience with event-driven architecture and message brokers (e.g., Kafka, RabbitMQ). Knowledge of containerization (Docker) and automated test suites (unit/integration/eval). Familiarity with CI/CD pipelines and Everything as Code mindset (infrastructure, prompts, and evals as code). Comfort with data-governance constraints and high-ownership problem-solving. Professional fluency in English; professional French for roles in France.Skills
Sign in to read and join the discussion.