Senior AI Engineer - Product-Facing LLMs (Remote FR/ES)
Posted Updated
Description
PayFit Ltd. is hiring for a senior software engineer to build product-facing AI experiences using LLMs and AI tooling. The role focuses on evaluating AI systems, ensuring reliable results, and improving data pipelines and knowledge services.
You will collaborate with engineering and business teams to deliver secure, maintainable AI-enabled solutions. You will join an AI-focused product team and contribute to long-term standards, ensuring quality, observability, and robust production practices
Build product-facing AI experiences using LLMs and generative AI that solve meaningful user problems. Design and develop ways to evaluate AI systems, assessing whether they answer correctly and perform the right task at the right moment. Define and improve quality signals that help the team understand how reliable and effective an AI experience is. Investigate failure modes and identify whether issues come from the model, the agent logic, retrieval, prompting, or missing knowledge. Analyse the knowledge available to AI agents and identify gaps, inconsistencies, or missing information that could affect answer quality. Improve the pipelines used to extract, structure, and provide knowledge to AI agents. Use evaluation results, user feedback, and production observations to continuously improve the reliability of our AI experiences. Contribute strong software engineering practices to the team's codebase and production systems. Help shape the team's approaches, tools, and technical standards as we build this capability over the long term. 7+ years of software engineering experience, including API and systems design. Proven hands-on experience building with LLMs, agents, tools, or AI workflow automation in production. Product sense: you can move from an ambiguous business problem to a reliable, maintainable production solution. Care for security, permissions, evaluation, observability, and maintainability in AI-enabled systems. Comfort working directly with non-technical users and collaborating across engineering and business teams. Ownership mindset across the full cycle: discovery, delivery, production quality, and iteration. Health insurance MacBook and work equipment Meal card Swile Time off: 25 days + RTT Parental supportSkills
Sign in to read and join the discussion.