Data Science & Quantitative AI Evaluation Specialist
About Gramian
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
About the Role
We are looking for Data Scientists and Quantitative Professionals to help evaluate and improve next-generation AI models. You will assess AI-generated solutions to problems involving statistics, machine learning, experimentation, and quantitative reasoning. You will also create challenging prompts, datasets, and verified reference solutions while identifying methodological flaws, statistical errors, and weaknesses in analytical reasoning. This role is ideal for candidates with relevant professional experience in technology, finance, or research who can communicate technical concepts clearly.
SENIORITY: Junior / Early-Career Professional
LANGUAGE: Strong written English
LOCATION: Remote — English-speaking countries
Key Responsibilities
Evaluate AI-generated outputs across data science, statistics, machine learning, experimentation, and quantitative problem-solving.
Create expert-level prompts, datasets, and reference solutions for AI training and evaluation.
Identify flawed methodologies, statistical inaccuracies, unsupported assumptions, and weaknesses in quantitative reasoning.
Assess the correctness, reliability, and clarity of analytical approaches and conclusions.
Provide structured, evidence-based feedback to help improve AI model capabilities.
Apply consistent evaluation criteria and communicate technical findings clearly.
Requirements
At least one year of professional experience at a recognized company in technology, finance, or research, with some of that experience gained within the past three years.
Foundational knowledge of data science, statistics, machine learning, or quantitative analysis.
Strong analytical and critical-thinking skills, with the ability to identify errors in data-driven reasoning.
Excellent written English and the ability to explain technical and statistical concepts clearly.
Ability to evaluate complex problems systematically and provide accurate, well-supported feedback.
Current residence in an English-speaking country.
Skills
As published by workable · 6 questions · 1 written answer
Basics
First name, Last name, Email, Phone, Address, Summary, Resume
Short answers (1)
- Please provide a valid and up-to-date LinkedIn profile URL that clearly reflects your professional experience, technical skills, and employment history relevant to the job. Example format: https://www.linkedin.com/in/yourprofile Applications with incomplete, inactive, or non-professional LinkedIn profiles may not be considered.
Pick from a list (4)
- Have you worked at a technology, finance, or research company within the past three years?
- How many years of professional experience do you have in technology, finance, research, or a related quantitative field?
- Which areas best match your experience?
- Are you currently based in an English-speaking country and comfortable writing technical feedback in English?
Written answers (1)
- What is your expected hourly rate? More affordable candidates will be prioritized.