AI Engineer

AI Engineer -RAG Platform favorite_border AI Engineer - RAG Platform Location: Utrecht Working hours: 36 hours per week Language: English, written and spoken Working arrangement: Hybrid About the role As an AI Engineer - RAG Platform, you will improve the quality, accuracy and effectiveness of a production Retrieval-Augmented Generation (RAG) platform. You will work at the intersection of information retrieval, data science and software engineering, focusing on the performance of the RAG system itself. You will investigate where and why the system underperforms, design experiments to test improvements, and translate your findings into measurable production outcomes. You will contribute throughout the improvement lifecycle, from failure analysis and hypothesis generation to evaluation, implementation and monitoring. Your work will draw on user feedback, retrieval metrics, evaluation datasets and production telemetry. You will collaborate with software engineers, platform engineers, data scientists and product managers. This is a hands-on specialist role focused on retrieval systems, evaluation methodologies and applied AI. What you'll do - Improve retrieval performance, answer quality and the overall user experience through analysis, experimentation and optimization. - Investigate low-quality answers and identify retrieval or grounding issues. - Develop automated evaluation frameworks to measure retrieval quality, answer quality and user satisfaction. - Run large-scale experiments on chunking, embedding and retrieval strategies. - Analyze user interactions and system performance data in Databricks to identify opportunities for improvement. - Build feedback loops that identify weak responses and inform ongoing development. - Define and monitor quality metrics to measure improvements and identify regressions. - Turn analysis and experimentation into scalable, maintainable production solutions. What you bring - A master's degr...