Data Scientist (Responsible GenAI)
Summary
Data Scientist on a Responsible GenAI team at a financial client in Utrecht, building evaluation capabilities and guardrails (LLM-as-a-judge, classifiers, rule-based controls) for GenAI solutions like assistants and document processing. Hands-on Python production work blending data science, software engineering and responsible AI; 6+ month contract via staffing firm Gazelle Global, hybrid with 1 d
Data Scientist (Responsible GenAI)
As a preferred supplier to one of our biggest Financial Client, I am seeking for a Data Scientist (Responsible GenAI) for a position in Utrecht, Netherlands. As a Data Scientist in our Responsible GenAI team, you build the evaluation capabilities and guardrails that help teams understand, measure and improve the quality and safety of their GenAI solutions.
You work at the intersection of data science, software engineering and responsible AI, translating real-world use cases and risks into robust evaluation methods, reusable tools and practical controls. Your work spans assistants, report generation, document processing and emerging agentic applications-not just chatbots.
This is a hands-on development role that requires strong statistical judgement and production experience. You design sound experiments, critically analyse data and metrics, and understand which conclusions the evidence does-and does not-support. You turn experiments into maintainable, tested, production-ready code and work with engineers to integrate it into deployed solutions. This is not a notebook-only role, nor does it require you to be an ML or platform engineer. The focus is not on training foundation models or conducting standalone research, but on making evaluation and safeguards work in practice.
Required Skills (Must-Haves):
1-Demonstrated expertise in GenAI systems
- Practical experience with LLM-based applications and an understanding of their limitations and failure modes.
- Familiarity with retrieval-augmented generation, prompting, grounding and context management.
- Ability to assess GenAI outputs against explicit criteria rather than relying only on intuition.
- Understanding of how changes to models, prompts, data or application logic can affect quality and safety.
2-Production-ready development and integration skills
- Strong Python skills and demonstrated experience turning experiments and prototypes into maintainable, tested, production-ready code-not only exploratory notebooks.
- Practical experience integrating data-science components with APIs, structured and unstructured data, and automated data-processing or evaluation pipelines.
- Hands-on experience with version control, automated testing, CI/CD and reproducible experimentation.
- Sufficient production experience to understand deployment, monitoring and production workflows, diagnose issues and deliver code that engineers can integrate and operate. ML or platform engineering specialisation is not required.
3-Statistical expertise, measurement and experimentation
- Demonstrated experience designing sound evaluations and experiments, and critically analysing metrics and datasets-not just applying evaluation frameworks.
- Strong applied statistical knowledge of sampling, dataset representativeness, uncertainty, metric reliability and experimental design, including the limitations of aggregate scores.
- Demonstrated experience validating automated evaluations against human assessments, assessing reliability and investigating disagreement.
- Ability to distinguish between weaknesses in the GenAI solution, the evaluation dataset and the evaluator itself, and explain which conclusions the data does-and does not-support.
4-Hands-on guardrail development and validation
- Practical experience assessing and selecting guardrail methods, including rule-based controls, LLM-as-a-judge approaches and trained ML classifiers, with clear reasoning about their suitability and limitations in context.
- Ability to translate a risk or expected behaviour into testable criteria and measurable controls, and to train or evaluate a classifier when that is the appropriate approach.
- Applied knowledge of precision and recall, detection thresholds, false positives, false negatives and class imbalance, and the ability to balance safety, usability and operational constraints.
- Experience testing controls across realistic scenarios, critically checking assumptions and assessing how data or behaviour drift affects guardrail performance over time.
5-Clear communication and collaboration
- Explain evaluation results, methodological choices and limitations to engineers, product managers and stakeholders.
- Work with use-case teams and domain experts to define what good performance means in context.
- Write clear technical proposals, evaluation reports and practical documentation.
- Turn ambiguous requirements into concrete experiments and implementation steps.
Contract: 6+ month
Rates: Excellent
Location: Utrecht
Hybrid working: 1 day on site
Interview: 2 stages
Nick Chinweerapunt
Account Manager
Gazelle Global Consulting
Tel +31 85 111 0171
Tel +44 203 588 7747
Mob +44 7377 403 773
Desired Skills and Experience
Data Science, Generative AI, Large Language Models (LLM), Python, Statistics, Experimental Design, Retrieval-Augmented Generation (RAG), Responsible AI, CI/CD, Prompt Engineering
Skills
Sign in to read and join the discussion.