Business Analyst - US - Educational Raters - Gemini | Job ID 100063

Vraify is hiring Business Analysts — US Educational Raters — Gemini to help evaluate and improve advanced AI systems through structured business and educational rating tasks.

What you’ll do • Review and rate AI-generated responses using clear business and educational criteria. • Analyze conversations and task outputs for accuracy, relevance, completeness, reasoning quality, and adherence to project guidelines. • Document evidence-based feedback, identify inconsistencies, and escalate ambiguous cases for review. • Apply consistent quality standards across a high-volume evaluation workflow.

What you bring • At least 1 year of relevant experience, including 18 months of conversation history. • Strong business analysis, written English, critical thinking, and attention to detail. • Ability to evaluate complex responses consistently and explain rating decisions with evidence. • Experience in education, training, content review, data annotation, or quality assurance is helpful.

Contract details • Contractor assignment with no medical or paid leave. • Full-time commitment for 16 weeks, starting as soon as possible. • $30/hour plus a one-time $5 payment described in the source role. • 100 positions. • Eligible locations: United States except Texas, Illinois, California, Connecticut, Massachusetts, New Jersey, and Vermont.

Shortlisted applicants will complete an interest check form and DM review. Final selected candidates will be contacted with onboarding requirements.Vraify is hiring an HR Manager to help train advanced AI systems through practical people management and HR leadership tasks.

What you’ll do • Create and evaluate high-difficulty tasks involving HR management, HR business partnering, and HR generalist or specialist work. • Develop and assess HR policies, employee relations approaches, organizational structures, and people programs. • Analyze HR scenarios, compare approaches, and ensure outputs are accurate, relevant, practical, and clearly reasoned. • Review and calibrate work against quality standards, incorporate feedback, and escalate edge cases or rubric ambiguities to the Functional SME lead.

What you bring • 3–15 years of professional experience in HR management, HR Business Partnering, or HR generalist or specialist roles. • Proven experience developing HR policies, managing employee relations, designing organizational structures, and partnering with business leaders. • Strong analytical, writing, stakeholder communication, and practical problem-solving skills. • Bachelor’s degree or equivalent practical experience. Experience in AI evaluation, data annotation, content review, or quality assurance is preferred but not required.

Contract details • Short-term contractor assignment for 8 weeks, starting immediately. • $100/hour USD for approved United States states under the country-specific guidelines. • 2 positions.

Shortlisted applicants will complete an interest check form and Vetsmith assessment. Final selected candidates will be contacted with onboarding requirements.Vraify is hiring HR & Talent Specialists — Senior Experts to help train advanced AI systems through specialized people and talent workflows.

What you’ll do • Create and evaluate high-difficulty tasks involving talent acquisition, total rewards, HR business partnering, and learning and development partnerships. • Design and assess specialized HR workflows, compensation and benefits structures, and practical people programs. • Analyze HR scenarios, compare approaches, and ensure outputs are accurate, relevant, practical, and clearly reasoned. • Review and calibrate work against quality standards, incorporate feedback, and escalate edge cases or rubric ambiguities to the Functional SME lead.

What you bring • 8–15 years of professional experience in a specialized HR domain such as Talent Acquisition, Total Rewards, HR Business Partnering, or L&D Partnerships. • Deep expertise in designing and executing specialized HR workflows and people programs. • Strong analytical, writing, stakeholder communication, and evidence-based reasoning skills. • Bachelor’s degree or equivalent practical experience. Experience in AI evaluation, data annotation, content review, or quality assurance is preferred but not required.

Contract details • Short-term contractor assignment for 8 weeks, starting immediately. • $82/hour USD for approved United States states under the country-specific guidelines. • 2 positions.

Shortlisted applicants will complete an interest check form and Vetsmith assessment. Final selected candidates will be contacted with onboarding requirements.Vraify is hiring Corporate Trainers / Curriculum — Expert to help train advanced AI systems through practical learning and curriculum tasks.

What you’ll do • Design and evaluate challenging tasks involving corporate training, curriculum development, and instructional design. • Create clear training materials, build structured curricula, and translate complex subject matter into practical learning experiences. • Review and calibrate work against quality standards, incorporate feedback, and escalate edge cases or rubric ambiguities to the Functional SME lead.

What you bring • 3–15 years of professional experience in corporate training, curriculum development, or instructional design. • Proven experience designing training materials, building curricula, and facilitating live or virtual learning programs. • Strong written communication, analytical thinking, and practical learning design skills. • Bachelor’s degree or equivalent practical experience. Experience in AI evaluation, content review, or quality assurance is preferred but not required.

Contract details • Short-term contractor assignment for 8 weeks, starting immediately. • $68/hour USD for approved United States states under the country-specific guidelines. • 2 positions.

Shortlisted applicants will complete an interest check form and Vetsmith assessment. Final selected candidates will be contacted with onboarding requirements.Vraify is hiring Political Scientists / Policy Analysts — Senior Expert to help train advanced AI systems through complex policy and political analysis tasks.

What you’ll do • Create and evaluate high-difficulty tasks involving policy analysis, political science, public administration, and government affairs. • Analyze policy scenarios, compare competing approaches, interpret evidence, and ensure outputs are accurate, relevant, practical, and clearly reasoned. • Review and calibrate work against quality standards, incorporate feedback, and escalate edge cases or rubric ambiguities to the Functional SME lead.

What you bring • Around 5–15 years of professional experience in policy analysis, political science, public administration, government affairs, or a closely related field. • An advanced degree such as an MPP, MPA, PhD, or equivalent qualification. • Strong analytical, research, writing, and evidence-based reasoning skills. • Experience translating policy, political, or government affairs issues into clear, practical analysis. • Bachelor’s degree or equivalent practical experience. Experience in AI evaluation, data annotation, content review, or quality assurance is preferred but not required.

Contract details • Short-term contractor assignment for 9 weeks, starting immediately. • $52–$82/hour USD for approved United States states under the country-specific guidelines. • 2 positions.

Shortlisted applicants will complete an interest check form and Vetsmith assessment. Final selected candidates will be contacted with onboarding requirements.Vraify is hiring Lawyers — Senior Expert to help train advanced AI systems through complex legal tasks and expert evaluation.

What you’ll do • Create and evaluate high-difficulty legal tasks and gold-standard solutions grounded in sound legal reasoning. • Analyze legal scenarios, identify risks, interpret applicable rules, and ensure outputs are accurate, practical, and well supported. • Review and calibrate work against quality standards, incorporate feedback, and escalate edge cases or rubric ambiguities to the Functional SME lead.

What you bring • Around 5–15 years of experience in regulatory law, compliance, risk management, or related legal advisory work. • Juris Doctor, law degree, or equivalent qualification, preferably with specialization or significant experience in regulatory and compliance matters. • Strong legal research, reasoning, drafting, and policy interpretation skills. • Experience applying laws, regulations, guidance, and internal policies to practical business requirements. • Bachelor’s degree or equivalent practical experience. Experience in AI evaluation, data annotation, content review, or quality assurance is preferred but not required.

Contract details • Short-term contractor assignment for 9 weeks, starting immediately. • $90–$140/hour USD for approved United States states under the country-specific guidelines. • 6 positions. • Availability and working requirements will be shared during the selection process.

Shortlisted applicants will complete an interest check form and Vetsmith assessment. Final selected candidates will be contacted with onboarding requirements.Vraify is hiring a Regulatory / Compliance Counsel — Senior Expert to help train advanced AI systems through high-difficulty legal and compliance tasks.

What you’ll do • Create high-difficulty expert tasks and gold-standard solutions reflecting real Regulatory and Compliance Counsel work. • Assess legal scenarios, identify regulatory risks, and ensure outputs are accurate, relevant, practical, and grounded in sound legal judgment. • Review and calibrate team output, own day-to-day quality, and escalate genuine edge cases or rubric ambiguities to the Functional SME lead.

What you bring • Around 5–15 years of experience in regulatory law, compliance, risk management, or related legal advisory roles. • Juris Doctor, law degree, or equivalent qualification, preferably with specialization or significant experience in regulatory and compliance matters. • Strong ability to interpret laws, regulations, regulatory guidance, and internal policies and translate them into practical business requirements. • Experience designing, implementing, and improving compliance programs, including policies, controls, monitoring, risk assessments, training, and regulatory reporting. • CCEP, CAMS, or an equivalent regional compliance credential is a plus. • Bachelor’s degree or equivalent practical experience. Experience in AI evaluation, data annotation, content review, or quality assurance is preferred but not required.

Contract details • Contractor assignment for up to 9 weeks, starting immediately. • $34/hour USD for APAC/EMEA and $100/hour USD for approved US states. • Availability: at least 4 hours per day and up to 40 hours per week, with 4 hours of overlap with Pacific Time. • Eligible locations: APAC/EMEA and approved United States states under the country-specific guidelines.

Shortlisted applicants will complete an interest check form. Final selected candidates will be contacted with onboarding requirements.Vraify is hiring a Principal GenAI Engineer to lead enterprise-scale AI implementations and build production-grade systems powered by large language models, retrieval-augmented generation, and agent-based architectures.

Location and work model • Remote. • Full-time. • Principal level, typically 10–14 years of experience.

What you’ll do • Design and build scalable GenAI applications using LLMs and RAG pipelines. • Develop and optimize backend services and APIs for AI-powered systems. • Build and deploy agent-based workflows and orchestration systems. • Integrate LLMs into real-world enterprise applications. • Ensure performance, scalability, and reliability of AI systems in production. • Collaborate with product, data, and engineering teams to deliver end-to-end solutions. • Implement monitoring, evaluation, and guardrails for GenAI systems.

What you bring • 8–14 years of software engineering experience in backend or full-stack roles. • 2+ years of hands-on experience with LLMs, including RAG, agents, and prompt engineering. • Strong experience building production-grade distributed systems. • Proficiency in Python, SQL, and NoSQL databases. • Hands-on experience with LangChain, LangGraph, or similar frameworks. • Experience deploying systems on AWS, Azure, or GCP. • Strong understanding of APIs, microservices, and system design.

Good to have • Experience with vector databases such as Pinecone, Weaviate, or FAISS. • Exposure to React or Next.js for full-stack work. • Familiarity with CI/CD and DevOps practices. • Understanding of model evaluation, fine-tuning, or LLMOps. • Experience building multi-tenant or enterprise SaaS platforms.

Why join • Work on cutting-edge GenAI use cases with global enterprises. • Build real-world AI systems at scale with high ownership and technical leadership.Vraify is hiring experienced Marketing Managers to serve as AI Trainers and help train advanced AI systems through complex, practical marketing tasks.

What you’ll do • Create, evaluate, and refine tasks involving marketing strategy, segmentation, positioning, campaign planning, channel optimization, performance measurement, and budget allocation. • Apply expert judgment to ensure outputs are accurate, practical, and commercially relevant across diverse markets and customer segments. • Produce expert tasks and gold-standard solutions to the quality bar, work under senior review, incorporate calibration feedback, and iterate. • Apply rubric standards set by the Functional SME lead.

What you bring • 8–15 years of experience in brand, product, growth, or integrated marketing, including leadership responsibilities. • Proven ability to develop marketing strategies aligned with customer needs, market opportunities, and business objectives. • Strong experience managing cross-channel programs across digital, content, paid media, lifecycle, partnerships, and offline channels. • Advanced proficiency in marketing analytics, attribution, performance measurement, experimentation, and customer insights. • Ownership of marketing budgets, resource allocation, agency management, and campaign ROI. • Expertise in brand positioning, messaging, go-to-market strategy, audience segmentation, and end-to-end campaign architecture. • Bachelor’s degree or equivalent practical experience. Experience in AI evaluation, data annotation, content review, or quality assurance is preferred but not required.

Contract details • Contractor assignment for up to 9 weeks, starting immediately. • $100/hour USD for approved US states. • Availability: at least 4 hours per day and up to 40 hours per week, with 4 hours of overlap with Pacific Time. • Eligible locations: approved United States states under the country-specific guidelines.

Shortlisted applicants will complete an interest check form and assessment.Vraify is hiring Senior Physician and Surgeon Experts to generate, evaluate, and refine high-difficulty tasks for advanced AI systems.

What you’ll do • Create technically accurate, practical tasks that test complex diagnostic reasoning, multi-system treatment planning, medical guideline interpretation, and clinical risk management. • Produce expert-level tasks and gold-standard solutions that meet a demanding quality bar. • Author realistic clinical scenarios, complex diagnostic workups, treatment plans, surgical consultation notes, and clinical case studies. • Apply rubric standards set by the Functional SME lead, work under senior review, incorporate calibration feedback, and iterate on task designs. • Verify that clinical scenarios, patient charts, and medical interventions are accurate, practical, and aligned with current guidelines.

What you bring • Approximately 8–15 years of post-residency clinical practice across inpatient, outpatient, or surgical settings, with active practice within the last 3 years. • MD, DO, or regionally equivalent medical qualification, with active or recent specialty board certification. • Deep expertise in complex diagnostic reasoning, differential diagnosis, evidence-based treatment planning, advanced medical guideline interpretation, and patient safety management. • Proven history producing high-level medical deliverables such as clinical management plans, diagnostic workups, surgical consultation notes, treatment protocol revisions, and clinical case studies. • Bachelor’s degree or equivalent practical experience. Experience in AI evaluation, data annotation, content review, or quality assurance is preferred but not required.

Contract details • Contractor assignment for 9 weeks, starting immediately. • $95/hour USD for LATAM, $122/hour USD for Europe, and $180/hour USD for approved US states. • 3 positions. • Availability: at least 4 hours per day and up to 40 hours per week, with 4 hours of overlap with Pacific Time. • Eligible locations: Brazil, Chile, Mexico, Canada, Colombia, Albania, Bosnia and Herzegovina, Croatia, Czech Republic, Estonia, Georgia, Hungary, Iceland, Latvia, Lithuania, Moldova, Monaco, Poland, Romania, Serbia, Slovakia, Slovenia, United Kingdom, and approved United States states under the country-specific guidelines.

Shortlisted applicants will complete an interest check form and assessment.Vraify is hiring Senior AI Trainers with deep marketing leadership experience to help train advanced AI systems through complex, practical marketing tasks.

What you’ll do • Create, evaluate, and refine tasks involving marketing strategy, audience segmentation, positioning, campaign planning, channel optimization, performance measurement, and budget allocation. • Apply expert judgment to ensure outputs are accurate, practical, and commercially relevant. • Produce expert tasks and solutions to the quality bar, work under senior review, incorporate calibration feedback, and apply rubric standards set by the Functional SME lead.

What you bring • 8–15 years of experience in brand, product, growth, or integrated marketing, including leadership responsibilities. • Proven ability to develop marketing strategies aligned with customer needs, market opportunities, and business objectives. • Strong experience managing cross-channel programs across digital, content, paid media, lifecycle, partnerships, and offline channels. • Advanced proficiency in marketing analytics, attribution, performance measurement, experimentation, and customer insights. • Experience owning marketing budgets, resource allocation, agency management, and campaign ROI. • Expertise in brand positioning, messaging, go-to-market strategy, audience segmentation, and end-to-end campaign architecture. • Bachelor’s degree or equivalent practical experience.

Contract details • Contractor assignment for up to 9 weeks, starting immediately. • $53/hour USD for LATAM and $100/hour USD for approved US states. • 2 positions. • Availability: at least 4 hours per day and up to 40 hours per week, with 4 hours of overlap with Pacific Time. • Eligible locations: Brazil, Chile, Mexico, Canada, Colombia, and approved United States states under the country-specific guidelines.

Shortlisted applicants will complete an interest check form and assessment.Vraify is hiring a Domain Reviewer to support quality assurance for AI evaluation projects across a broad range of academic, research, and industry disciplines.

What you’ll do • Review and validate domain-specific prompts within your area of expertise. • Evaluate completed tasks for factual accuracy, reasoning quality, completeness, and compliance with project guidelines. • Identify factual inaccuracies, logical inconsistencies, hallucinations, outdated information, and low-quality annotations. • Ensure prompts are challenging, relevant, and aligned with project objectives. • Provide clear, constructive, evidence-based feedback and document review findings. • Follow established quality standards, escalate ambiguous cases, and collaborate with project managers and AI teams to improve review processes.

What you bring • Master’s degree or higher in a relevant academic or professional discipline. • At least 3 years of professional, research, teaching, or industry experience in your area of expertise. • Experience reviewing, evaluating, editing, or quality-checking domain-specific content is preferred. • Excellent written English communication and analytical skills. • Strong attention to detail and ability to identify factual, logical, and contextual errors.

Contract details • Contractor assignment with no medical or paid leave. • Full-time: 40 hours per week, with at least 4 hours of overlap with Pacific Time. • Up to 8 weeks, starting immediately. • $12/hour USD. • 2 positions. • Greenlit locations except the United States.

Shortlisted applicants will complete an interest check form, assessment, and DM review.