AI Engineer, Quality AI & Data — Build Trusted AI Tools
Posted Updated
Description
Novo, Quality AI & Data, is seeking an AI Engineer to design and build agent-based AI solutions that streamline quality processes. You will develop production-ready software, integrating APIs, data processing components, and AI models, while collaborating with users and process experts to refine workflows.
You will evaluate AI components and orchestrations, ensure robust testing and version control, and contribute to a regulated, high-stakes environment in Ballerup, Denmark.
Design and build agents, including orchestration, retrieval, tool use and integrations with enterprise systems and data sources. Build the software around the AI, such as APIs, data processing and application components, so the result is a usable product. Work directly with users and process experts to understand workflows, test prototypes and improve based on feedback. Develop evaluation datasets and automated evaluations covering individual components and complete agent workflows. Use evaluations, regression tests and production feedback to investigate failures and assess changes to models, prompts, tools and orchestration. Apply sound engineering practices, including code review, automated testing, version control, deployment and monitoring. A relevant university degree. Demonstrated ability to build and deploy software, explain decisions, problems faced and lessons learned. Strong programming skills in Python or another relevant language, with APIs, databases and cloud services. Practical experience building LLM applications and agentic pipelines, including context management, retrieval, tool use and orchestration. Experience building evaluations from scratch: defining success with domain experts, creating representative test cases, automating checks and investigating failures across multistep workflows. Ability to turn an exploratory prototype into maintainable software. Ownership when requirements are incomplete: test assumptions early and ask for input. Clear written and spoken English and ability to explain technical choices to diverse audiences. Interest in applying AI to pharmaceutical quality.Skills
Sign in to read and join the discussion.