Remote AI Quality Evaluator — Contractor
YO AI Labs
New York, NY
- Remote job
YO AI Labs is seeking an AI Evaluation Specialist contractor to assess AI outputs against established rubrics, identify gaps, and provide actionable feedback to improve enterprise AI training systems. The role requires strong analytical writing skills, familiarity with grading workflows, and the ability to work independently on high-volume evaluations, using tools like ChatGPT or Claude on a daily basis. #J-18808-Ljbffr YO AI Labs
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote AI Quality Evaluator — Contractor in New York, NY vacancy
- ...About the role Swahili Evaluation AI Evaluator is a remote evaluation track for reviewing swahili generalist... ...and responses against AuraOne's quality rubric. Reviewers compare paired outputs... ...· Location: Remote — US-eligible · Contractor Swahili Evaluation AI Evaluator is...For contractorsRemote workQualityHourly pay10 hours per week
AI Trainer Jobs
New York, NY16 hours ago - YO AI Labs is seeking an AI Evaluation Specialist to remotely assess enterprise AI outputs against detailed rubrics, measuring accuracy, relevance and quality. You will provide concise, actionable feedback to drive improvements. Responsibilities include identifying reasoning...For contractorsRemote jobQuality
- AI Trainer Jobs is seeking a Lesson Plan AI Evaluator for a remote, contractor role. You will review prompts and responses against AuraOne's quality rubric, label edge cases, and provide structured feedback to help retrain models. Responsibilities include evaluating model...For contractorsRemote jobQuality
- AuraOne is seeking a Children Safety Content AI Evaluator for a remote, contractor-based role. You will evaluate model outputs, compare responses, and label content with structured tags according to our quality rubric. Ideal candidates have prior evaluation/annotation experience...For contractorsRemote jobQuality10 hours per week
- YO AI Labs is seeking an experienced AI Evaluation Specialist to remotely assess AI assistant outputs for an enterprise training project. The contractor will evaluate responses against detailed rubrics, identify issues, and provide actionable feedback to improve AI systems...For contractorsRemote jobQuality
- Historical Reasoning AI Evaluator is a remote evaluation track for reviewing historical reasoning ai... ...and responses against AuraOne's quality rubric. Reviewers compare paired outputs... ...process · Location: Remote — US-eligible · Contractor Historical Reasoning AI Evaluator is...For contractorsRemote workQualityHourly pay10 hours per week
- ...micro1 is hiring Gmail & Google Calendar AI Assistant Evaluators to collaborate on a customer-driven project that enhances AI assistant quality through real-world task evaluation. In this contractor, remote role, you will use your everyday experience managing digital...For contractorsRemote jobQuality
- ...Product Management & Marketing to remotely review evaluation prompts and responses against the company's quality rubric. You will compare... ...team can use to retrain. As a contractor, you will assess frontier... ...reasoning, and reliable async #J-18808-Ljbffr AI Trainer JobsFor contractorsRemote jobQuality
- AuraOne is seeking remote Social Content Quality Evaluators to review model outputs and prompts against our quality... ...and tasks. As an independent contractor working remotely from the US, you will... ...document reasoning for rubric clauses. #J-18808-Ljbffr AI Trainer JobsFor contractorsRemote jobQuality
- YO AI Labs is seeking Lawyers/Legal Writers for a remote, contractor role to evaluate AI-generated legal and technical content. You will apply your expertise in legal writing... ...review, and critical analysis to assess quality and accuracy without providing legal advice....For contractorsRemote jobQuality
- AI Trainer Jobs seeks a Brazilian Portuguese AI Evaluator for a remote evaluation track. Review prompts and responses against AuraOne's quality rubric, label edge cases, and write structured feedback... ...with rubric clauses. This is a contractor role with US-eligibility for...For contractorsRemote jobQuality
- About the role PhD Mathematics AI Evaluator is a remote review track for evaluating AI outputs across... ...Remote · Independent specialist contractor Compensation Hourly rate confirmed after... ...the cited papers and rate the citation quality. Adjudicate a disputed answer between...For contractorsRemote workQualityHourly pay10 hours per week
- YO AI Labs seeks PhD and academic experts to support AI research projects remotely. You will evaluate model outputs across technical and humanities topics... ...accuracy and depth. As a contractor, you will create reference prompts, critiques, and quality benchmarks, and...For contractorsRemote jobQuality
- YO AI Labs is seeking a Creative & Design Specialist (Contractor) to support projects across graphic design, multimedia production, UI/UX, and motion graphics. You will review AI-generated outputs, provide high-quality human feedback, and help refine creative workflows...For contractorsRemote jobQuality
$40 - $100 per hour
About OpenTrain OpenTrain AI is the hiring and... ...technical conclusions. Remote contract engagement Part... ...Training and Scientific Evaluation AI training is the human... ...reasoning and provide high-quality scientific judgment on... ...This is a part-time contractor opportunity with remote...For contractorsRemote workQualityHourly payContract workPart time- ...Role Title: Gmail & Google Calendar AI Assistant Evaluator Role Type: Contractor, Remote Location: United States only micro1 is engaging Gmail... ...a customer-driven project enhancing AI assistant quality through real-world task evaluation. In this role,...For contractorsRemote workQuality
- AuraOne is seeking a Fluid Dynamics AI Reviewer to remotely evaluate prompts and responses against its quality rubric. You will compare paired outputs, label edge cases... ...feedback to retrain the model. This contractor role requires careful reasoning, detail orientation...For contractorsRemote jobQuality10 hours per week
$30 - $55 per hour
...centralized, open platform where AI training and data-labeling... ...area. What you will do evaluate model outputs, apply project... ...behavior Maintain consistency and quality across repeated review tasks... ...working independently on remote contractor tasks Schedule and pay Remote...For contractorsRemote workQualityFreelance10 hours per week- AI Trainer Jobs is seeking a Document Annotation Specialist for a remote evaluation role. You’ll review prompts and responses against the AuraOne rubric,... ...and contribute to calibration and quality assurance processes. This contractor role requires reliable weekly hours...For contractorsRemote jobQuality
- AI Trainer Jobs is seeking a remote Management Consultant — AI Workflow Evaluator to review prompts and model outputs against AuraOne's quality rubric. You will compare paired outputs, label edge cases... ...can use to retrain. As a contractor, you will annotate and rate...For contractorsRemote jobQuality
$40 per unit
AI Trainer Jobs is seeking detail-oriented freelance data... ...annotators to join a fully remote, independent contractor program. You will label text... ...guidelines, and deliver quality annotations on a flexible schedule... ...data labeling and ML data evaluation is preferred. #J-18808-...For contractorsRemote jobQualityHourly payWeekly payContract workFreelanceFlexible hours- RemoteJobsOne is seeking a Content Writer & Editor for a fully remote contractor role open to US-based candidates. You will contribute to customer projects by evaluating and editing text quality and AI training data, ensuring clarity, correctness, and consistency across...For contractorsRemote jobQuality
- ...Mental Health Clinical AI Evaluator is a remote clinical-review track for evaluating AI outputs that... ...guidelines. Maintain reviewer-quality scores in weekly inter-rater calibration... ...eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR....For contractorsRemote jobQualityHourly pay10 hours per week
- ...Legal Citation AI Evaluator is a remote review track for evaluating AI outputs in legal review workflows... ...or firm policy. Maintain reviewer-quality scores in inter-rater calibration... .... Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants...For contractorsRemote jobQualityHourly pay10 hours per week
- ...Privacy Law AI Evaluator is a remote review track for evaluating AI outputs in privacy law workflows... ...or firm policy. Maintain reviewer-quality scores in inter-rater calibration... ...eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR....For contractorsRemote jobQualityHourly pay10 hours per week
$60 - $65 per hour
...Help improve next generation AI language systems by evaluating AI generated Indonesian... ...Deliver consistently high quality assessments within project... ...to work independently in a remote setting and meet project... ...Terms ~ Remote independent contractor engagement....For contractorsRemote workQualityHourly paySaidGig
United States2 days ago$80 - $120 per hour
...Cybersecurity / IT GRC Evaluator is a remote evaluation track for reviewing cybersecurity... ...responses against AuraOne's quality rubric. Reviewers compare... .... Why this role matters AI data reviewers help turn... ...· Independent specialist contractor. Employment type: CONTRACTOR...For contractorsRemote jobQuality10 hours per week- ...Special Education AI Evaluator is a remote review track for evaluating AI outputs across education... ...firm guidance. Maintain reviewer-quality scores in inter-rater calibration cycles... .... Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants...For contractorsRemote jobQualityHourly payWork experience placement10 hours per week
- ...Audit and Controls AI Evaluator is a remote review track for evaluating AI outputs across audit workflows... ...firm guidance. Maintain reviewer-quality scores in inter-rater calibration... .... Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants...For contractorsRemote jobQualityHourly payWork experience placement10 hours per week
$30 - $65 per hour
...Help improve next-generation AI systems by evaluating Dutch-language audio and providing clear,... ...native-level linguistic feedback. This remote contractor role centers on assessing how... ...specific tools and guidance. Work with quality assurance leads to maintain consistent...For contractorsRemote workQualityHourly paySaidGig
United States2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Quality Evaluator — Contractor. Be the first to apply!
Related searches
- ai evaluator New York, NY
- education evaluator New York, NY
- work from home web search evaluator New York, NY
- evaluator New York, NY
- program evaluator New York, NY
- work from home social media evaluator New York, NY
- clinical evaluator New York, NY
- social media evaluator New York, NY
- quality evaluator New York, NY
- revenue manager remote New York, NY