Remote AI Quality Evaluator
YO AI Labs
- Remote job
YO AI Labs is seeking an experienced AI Evaluation Specialist to remotely assess AI assistant outputs for an enterprise training project. The contractor will evaluate responses against detailed rubrics, identify issues, and provide actionable feedback to improve AI systems. No prior formal AI experience is required, but strong analytical and communication skills are essential. Responsibilities include applying consistent judgments across large volumes, documenting evaluations, and contributing #J-18808-Ljbffr YO AI Labs
$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...Remote workQualityHourly payPart timeFlexible hours- ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional...Remote workQualityWork at office
$11.5 per hour
...institution is offering a part-time remote position as an Online Task... .... In this role, you will evaluate and provide feedback on content... ...enhance search engine results and quality. No prior experience is needed... ...of contributors involved in AI advancements. #J-18808-Ljbffr...Remote workQualityHourly payPart time$20 per hour
A leading AI development company in the United States is seeking detail-oriented individuals for remote opportunities in training AI chatbots. Responsibilities include... ...developing prompts, writing high-quality responses, and evaluating AI outputs. The ideal candidates...Remote workQualityHourly payFlexible hours- ...Polish Bilingual Expert (contractor) to evaluate Polish audio content for AI training. The role emphasizes nativeness, fluency, and linguistic quality, with feedback delivered in English.... ...to detail and the ability to work remotely. No prior AI experience is required;...Remote jobQualityFor contractors
- YO AI Labs is seeking an AI Evaluation Specialist to remotely assess enterprise AI outputs against detailed rubrics, measuring accuracy, relevance and quality. You will provide concise, actionable feedback to drive improvements. Responsibilities include identifying reasoning...Remote jobQualityFor contractors
$20 - $30 per hour
A remote-focused technology firm is looking for an individual proficient in evaluating large language model outputs. The role involves assessing AI systems, reviewing workflows, and providing actionable feedback to enhance product quality. Ideal candidates will have strong...Remote jobQualityHourly pay- AI Trainer Jobs is seeking a Lesson Plan AI Evaluator for a remote, contractor role. You will review prompts and responses against AuraOne's quality rubric, label edge cases, and provide structured feedback to help retrain models. Responsibilities include evaluating model...Remote jobQualityFor contractors
- Turing is a leading AI company enabling the rapid deployment of... ...We are seeking a contractor to evaluate chatbot responses across real-... ...decisions. You will work remotely on a 16-week project, collaborating... ...a global team to ensure high-quality evaluations and practical recommendations...Remote jobQualityFor contractorsFreelance
- Mercor is seeking expert Evaluators in Clinical / biomedical / pharma to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. This is a remote, hourly engagement. You will apply deep subject-matter...Remote jobQualityHourly pay
$24 per hour
Prolific is seeking Fluent Tamil speakers to serve as AI evaluators on a remote, freelance basis. You will assess how well AI models capture emotions... ...nuance, and fluent English communication. A quiet setup and quality audio equipment are expected. #J-18808-Ljbffr ProlificRemote jobQualityFreelance- Obsidian is seeking expert Evaluators for a remote, hourly role focused on reviewing AI-generated work products for quality and accuracy. The successful candidates will leverage their subject matter expertise to assess various documents, spreadsheets, and slide decks....Remote jobQualityHourly payWork at office
- Obsidian is seeking expert Evaluators in Humanities / arts / culture to review AI-generated work products for accuracy, rigor, and domain quality. You will apply subject-matter expertise to grade... ...structured feedback. This is a remote, hourly engagement, with work delivered...Remote jobQualityHourly payWork at office
- AuraOne is seeking a Spanish Dialect AI Evaluator to review prompts and responses against its quality rubric. This remote contractor track involves comparing paired outputs, labeling edge cases, and writing structured feedback for retraining. You will help turn Spanish...Remote jobQualityFor contractors
- YO AI Labs is seeking a Healthcare Expert for a remote contract to support AI training and evaluation projects. You will apply clinical knowledge to assess AI outputs, workflows, and real-world use of healthcare systems. Key tasks include evaluating EHR applications, reviewing...Remote jobQualityContract work
- YO AI Labs is seeking Content Writers & Editors to contribute to a customer project focused on text quality and AI evaluation. You will apply your writing and editing expertise to help train and... ...skills are what matter. Work is remote with collaboration across project coordinators...Remote jobQuality
- AuraOne is seeking a Children Safety Content AI Evaluator for a remote, contractor-based role. You will evaluate model outputs, compare responses, and label content with structured tags according to our quality rubric. Ideal candidates have prior evaluation/annotation experience...Remote jobQualityFor contractors10 hours per week
$30 per hour
...Compensation: $20-$30/hour Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language... ...systems using defined rubrics and quality standards. Review multi-step... ...Strong experience in LLM evaluation, AI output analysis, QA/testing, UX...Remote jobQualityHourly payContract work$24 per hour
Prolific is seeking an AI Trainer with advanced Tamil fluency to evaluate AI models' understanding of the Tamil language... ...cultural relevancy, and ensuring quality control in audio outputs. The role... ...for tasks, with flexible hours and remote work options. J-18808-Ljbffr...Remote jobQualityFlexible hours- About the role Conversational AI Evaluator is a remote evaluation track for reviewing conversational ai evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the...Remote workQualityHourly payFor contractors10 hours per week
- Obsidian is hiring expert Evaluators in Healthcare operations for a remote, hourly engagement. You will review AI-generated work products for accuracy, rigor, and domain quality, leveraging your extensive subject-matter expertise in the field. The ideal candidate has over...Remote jobQualityHourly payWork at office
- About the role Swahili Evaluation AI Evaluator is a remote evaluation track for reviewing swahili generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback...Remote workQualityHourly payFor contractors10 hours per week
- Mercor is hiring expert Evaluators in Healthcare operations to review AI-generated outputs (documents, spreadsheets, and slide decks) for accuracy and domain quality. This is a remote, hourly engagement.You will apply deep subject-matter expertise to grade outputs, identify...Remote jobQualityHourly pay
- About the role PhD Mathematics AI Evaluator is a remote review track for evaluating AI outputs across mathematics reasoning, calculations, and... ...literature summary against the cited papers and rate the citation quality. Adjudicate a disputed answer between two reviewers using...Remote workQualityHourly payFor contractors10 hours per week
$14.5 per hour
Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies... ...to provide datasets that are high-quality, ethically sourced, relevant, diverse,... ...is beneficial. Seeks a flexible, remote job that can easily fit around other commitments...Remote workQualityHourly payPart timeImmediate startWork from home10 hours per weekFlexible hours- Mercor is seeking expert Evaluators in People ops / recruiting to review AI-generated work products for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs. This is a remote, hourly engagement. You will evaluate artifacts against...Remote jobQualityHourly pay
- ...Workflow Annotator—Product Management & Marketing to remotely review evaluation prompts and responses against the company's quality rubric. You will compare paired outputs, label... ...attention to detail, clear written reasoning, and reliable async #J-18808-Ljbffr AI Trainer JobsRemote jobQualityFor contractors
- ...Healthcare is seeking a meticulous Gmail & Google Calendar AI Assistant Evaluator for a remote contract role based in the United States. You will... ...while collaborating with project trainers to maintain high-quality evaluation #J-18808-Ljbffr Executive Staff Recruiters /...Remote jobQualityContract work
- YO AI Labs seeks PhD and academic experts to support AI research projects remotely. You will evaluate model outputs across technical and humanities topics, using your subject-matter... ...reference prompts, critiques, and quality benchmarks, and contribute to peer review...Remote jobQualityFor contractors
- AI Trainer Jobs seeks a Brazilian Portuguese AI Evaluator for a remote evaluation track. Review prompts and responses against AuraOne's quality rubric, label edge cases, and write structured feedback for retraining the model. Responsibilities include comparing paired outputs...Remote jobQualityFor contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Quality Evaluator. Be the first to apply!
- ai evaluator Los Angeles, CA
- education evaluator Los Angeles, CA
- evaluator Los Angeles, CA
- social media evaluator Los Angeles, CA
- title examiner remote Los Angeles, CA
- remote social worker Los Angeles, CA
- remote nurse practitioner Los Angeles, CA
- remote coding manager Los Angeles, CA
- product designer remote Los Angeles, CA
- customer service rep remote Los Angeles, CA

