Remote AI Quality Evaluator
YO AI Labs
Los Angeles, CA
- Remote job
YO AI Labs is seeking an experienced AI Evaluation Specialist to remotely assess AI assistant outputs for an enterprise training project. The contractor will evaluate responses against detailed rubrics, identify issues, and provide actionable feedback to improve AI systems. No prior formal AI experience is required, but strong analytical and communication skills are essential. Responsibilities include applying consistent judgments across large volumes, documenting evaluations, and contributing #J-18808-Ljbffr YO AI Labs
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Remote AI Quality Evaluator in Los Angeles, CA vacancy
- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...Remote workQualityContract workTemporary workImmediate start
MERIT Beauty
New York, NY4 days ago - ...Medical Translation AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch clinical review. Reviewers grade differential... ...evidence or specialty guidelines. Maintain reviewer-quality scores in weekly inter-rater calibration cycles. Qualifications...Remote workQualityHourly payFor contractors10 hours per week
AuraOne, Inc.
New York, NY16 hours ago $70 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to... ...feedback to improve training data quality and downstream performance. Develop...Remote workQualityContract workSummer workMercor
Seattle, WA8 days ago$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... ...with financial-services AI Evaluator Type: Contract Compensation... ...$80–$120/hour Location: Remote Role Responsibilities... ...artifacts against domain-specific quality rubrics. Identify factual,...Remote workQualityContract workSummer workWork at officeMercor
Chicago, IL21 days ago- Embedded Shishya is seeking English-speaking Image Quality Evaluators based in South Korea to support AI training and evaluation projects. You will review images, assess quality, and provide English descriptions while considering South Korean culture and local context....Remote jobQualityFor contractorsLocal area
$14.5 per hour
...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology... ...to provide datasets that are high-quality, ethically sourced, relevant, diverse,... ...analysis is beneficial. Seeks a flexible, remote job that can easily fit around other...Remote workQualityHourly payPart timeImmediate startWork from home10 hours per weekFlexible hoursWelo Data
Georgia16 hours ago$50 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated English text across...Remote workQualityContract workSummer workMercor
San Jose, CA20 days ago- ...seeking a native or near-native Korean speaker to remotely evaluate healthcare front desk conversations with an AI, role-playing as a patient and recording dialogue... ...flexible hours and a quiet home workspace for quality contributions to AI research. #J-18808-Ljbffr Alignerr...Remote jobQualityContract workFlexible hours
- Turing is seeking detail-oriented AI Analysts based in the United States for a Google Wallet evaluation project. This role allows you to engage with advanced AI tools... ...You will evaluate model responses, review output quality, and provide structured feedback. The position...Remote jobQualityFull timeContract work
- RWS is seeking a part-time Search Quality Evaluator to help improve AI-driven search results. You will test how search engines respond to everyday queries from regular users, provide feedback on text, audio, images, and videos, and help refine data used by major platforms...Remote jobQualityPart timeWork from homeFlexible hours
- Anyone AI is seeking a QUALITY EVALUATOR - ENGLISH to help shape the future of AI by evaluating and comparing responses from advanced AI models. This remote, part-time independent contractor role lasts up to 3 months and pays $7-$12 per hour. You’ll work with English-language...Remote jobQualityHourly payPart timeFor contractors
- ...experienced supply chain professionals to train and evaluate AI systems with real-world domain judgment. This is a remote, project-based role: apply your hands-on... ...content, applying professional judgment to assess quality and realism, and delivering clear, #J-18808-Ljbffr...Remote jobQualityFlexible hours
- RWS Group is seeking a Speech AI Evaluation Specialist to support the improvement of AI-generated... ...freelance, part-time position offers remote work from home in the USA, with a flexible... ..., accuracy, clarity, and overall quality, and provide objective ratings according...Remote jobQualityPart timeFreelanceImmediate startWork from home10 hours per weekFlexible hours
- Frontier AI Lab is seeking a Gmail & Google Calendar AI Assistant Evaluator to work remotely as a contractor in the United States. You will perform everyday digital tasks,... ...project milestones with precise data submissions and quality reviews. #J-18808-Ljbffr RemotebridgeRemote jobQualityFor contractors
- YO AI Labs is seeking Content Writers & Editors to contribute to a customer project focused on text quality and AI evaluation. You will apply your writing and editing expertise to help train and... ...skills are what matter. Work is remote with collaboration across project coordinators...Remote jobQuality
$30 per hour
...Compensation: $20-$30/hour Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language... ...systems using defined rubrics and quality standards. Review multi-step... ...Strong experience in LLM evaluation, AI output analysis, QA/testing, UX...Remote jobQualityHourly payContract work- Synthires is seeking a remote contract evaluator to support an AI training project. You will review short English audio recordings, judge naturalness for... ...and provide structured feedback to improve AI speech quality. Ideal candidates have native-level English,...Remote jobQualityHourly payContract work
$15 - $16 per hour
...Partners in the United States invites applicants for a full-time, remote data evaluation and annotation role. The position requires fluency in... ...entry to mid-level role focuses on language data, platform management, and quality assurance. #J-18808-Ljbffr Volga PartnersRemote jobQualityHourly payFull time- Brazilian Portuguese AI Evaluator is a remote evaluation track for reviewing portuguese generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling...Remote workQualityHourly payFor contractors10 hours per week
- ...Category: Frontier Model Evaluation Pay: Hourly rate confirmed after the interview process Location: Remote US-eligible Contractor AI Trainer & Evaluator is a remote evaluation track for... ...and responses against AuraOne's quality rubric. Reviewers compare paired outputs...Remote workQualityHourly payFor contractors10 hours per week
AuraOne
New York, NY2 days ago $14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...Remote jobQualityHourly payPart timeFlexible hours$18 per hour
AI Linguistic Evaluator - Telugu Dallas, Texas RWS - TrainAI / Temporary/Contract / Remote Freelance Remote from the United States Flexible Immediately Approximately 10-1... ...English skills and a keen eye for language quality? Join a remote AI project where you’ll...Remote jobQualityTemporary workFreelanceImmediate startFlexible hours$18 per hour
We are looking for AI Linguistic Evaluators to assess how effectively an AI application performs in Telugu... .... Job Type: Freelance Location: Remote from the United States Work Schedule:... ...skills and a keen eye for language quality?Join a remote AI project where you'll...Remote workQualityFreelanceImmediate startFlexible hours- Create challenging prompts and evaluate large language model responses... ...management experience. 100% Remote Contract, part-time Engagement... ...execution to assess how well AI handles management-related topics... ..., relevance, and overall quality. Find factual errors, logical...Remote workQualityContract workPart timeFor contractorsWorldwide
- Materials Science AI Evaluator is a remote review track for evaluating AI outputs across materials science reasoning, calculations, and research... ..., papers, or community standards. Maintain reviewer-quality scores in inter-rater calibration cycles. Qualifications...Remote workQualityHourly payFor contractors10 hours per week
- Remotebridge is seeking a Journalist/Writer contractor to join a remote project evaluating AI-generated writing. You will assess responses to prompts, apply domain knowledge, and contribute high-quality inputs to training AI systems. You will work independently, score writes...Remote jobQualityFor contractors
$13 per hour
...Argentina | Belize | Bolivia + 15 more Help evaluate how an AI assistant uses information from... ...respond to personalized prompts. This remote project is for people based in Canada,... ...evaluation, annotation, content review or quality assurance experience is helpful but not...Remote workQualityHourly payFor contractors- ...Company is seeking a Content Specialist III to evaluate, improve, and shape AI content across diverse topics. The role focuses on high-quality, accurate model responses, requiring... ...guidelines consistently. The position is remote in the United States, with a 6+ month...Remote workQualityContract work
$30 - $49 per hour
AI Generalist Digital Workflow Evaluator Review AI-generated outputs and workflow screenshots, apply project guidelines... ..., and write clear feedback. This remote US contract pays $30 to $49 per... .... Maintain consistent, accurate quality across repeated review tasks. What...Remote workQualityHourly payContract workPart timeFor contractorsFlexible hours$35 - $40 per hour
A leading evaluation organization seeks a Generalist Evaluator Expert for a remote, flexible contract role. This position involves designing prompts for language model evaluations... ...and critical thinking skills, familiarity with AI tools like ChatGPT, and a BS or BA degree. This...Remote jobQualityContract workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Quality Evaluator. Be the first to apply!
Related searches
- social media evaluator Los Angeles, CA
- evaluator Los Angeles, CA
- ai evaluator Los Angeles, CA
- education evaluator Los Angeles, CA
- quality evaluator Los Angeles, CA
- senior devops engineer remote Los Angeles, CA
- hr manager remote Los Angeles, CA
- remote french Los Angeles, CA
- clinical research remote Los Angeles, CA
- remote support technician Los Angeles, CA