Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

ProRekruter

NewBe an early applicant

German AI Evaluation Agent | Generative AI & LLMs | Lisbon Oriente | Start 9.11

Posted
Discussion

Summary

Office-based role in Lisbon (Oriente) starting 9.11: evaluate and label German-language AI/LLM chatbot responses for a short-form video platform — rating correctness, comparing answers, and flagging issues to improve models. Requires C2 German and B2 English; 6-month contract, 24/7 rotational 8h shifts.

Use your German language skills to help improve Generative AI and Large Language Models.
Join an international AI Evaluation project supporting a leading short-form video and technology platform.

✅ Apply in one easy step — click the 'APPLY FOR JOB' button and complete our short application form here: https://prorekruter.com/jobs/german-ai-evaluation-agent-lisbon/net/

• Start: 9.11
• Office-based work in Lisbon – Oriente
• Monday–Sunday, 24/7 rotational shifts — 8h/day, 40h/week, 5 working days and 2 rotating days off
• Fast and fully online recruitment process

✅ About the Project
As an AI Labeling & Evaluation Agent, you will work with content generated by AI models, such as chatbot responses. Your job is to check whether the answers are correct, useful, relevant and well written, compare different responses and provide feedback that helps train and improve AI systems. This is a great opportunity to gain hands-on experience in AI evaluation, data annotation and LLM quality while working on an international technology project.

✅ What you will do:
• Read and evaluate responses created by AI
• Decide whether an answer is correct, useful and well written
• Compare different AI responses and choose the stronger one
• Label and categorize content according to project guidelines
• Spot errors, inconsistencies and unusual cases
• Check that content meets quality and safety standards
• Flag difficult or unclear cases for further review
• Provide accurate feedback that helps train and improve AI models

✅ Salary:
• Base salary: approximately €1,283 gross/month ×12 or €1,100 gross/month ×14 — choose your payment schedule
• Fixed project bonus: €200 gross/month
• Meal allowance: €7.63 net per worked day, approximately €167.86 net/month via meal card
Average monthly gross package: approximately €1,483 gross/month €168 net/month meal card.

✅ What we offer:
• Start dates: 9.11
• Full-time 6-month employment contract with possibility of extension under Portuguese law
• Office-based work in our modern Lisbon Oriente location
• Full project training at the beginning of your employment
• Private Health Insurance from Day 1
• Bring a Friend Program with attractive incentives
• Fast and fully online recruitment process
• International and multicultural working environment
• Valuable professional experience in Generative AI, LLM Evaluation and AI Data Annotation

✅ Who we are looking for:
• Excellent written German – C2 level required
• English at B2 level or higher
• Strong understanding of Generative AI and Large Language Models (LLMs)
• Strong written language skills and attention to detail
• Good analytical and critical-thinking skills
• Comfortable reviewing text, structured data and AI-generated content
• Previous experience in AI Data Annotation, LLM Evaluation, RLHF, SFT, Quality Assurance, Content Labeling or Trust & Safety is a strong advantage
• EU citizenship or a valid Portuguese residence and work permit

✅ Ready to Work with Generative AI?
Turn your German language and analytical skills into practical experience in LLM Evaluation, AI Data Annotation and Quality Assurance.
Apply with your CV and join our next training group starting on 9.11!

Explore more jobs in Portugal
Related Searches:
German AI Jobs Lisbon · German AI Evaluation Agent · LLM Evaluation Lisbon · Generative AI Portugal · AI Data Annotation · AI Quality Analyst · German-speaking Jobs Portugal

✅ Ready to apply? One easy step — click the 'APPLY FOR JOB' button and complete our short application form here: https://prorekruter.com/jobs/german-ai-evaluation-agent-lisbon/net/

✅ More German-speaking jobs in Portugal can be found on our job board: https://prorekruter.com

Skills

Apply

See also

AI Engineering jobs by country — openings, pay and top skills →