Remote Evaluation Specialist, AI Domain Ops
AuraOne Human Data
New York, NY
- Remote job
AuraOne, Inc. is seeking a Domain Contributor Evaluation Specialist for a remote contractor role in the United States. You will review AI outputs against workflows, policy, and stakeholder-fit using a structured rubric, and document the next steps for model training. Responsibilities include grading tone, escalation logic, risk flags, and ensuring adherence to playbooks. Strong attention to detail and the ability to work asynchronously for at least 10 hours per week are required. #J-18808-Ljbffr AuraOne Human Data
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Remote Evaluation Specialist, AI Domain Ops in New York, NY vacancy
- Domain Contributor - Evaluation Specialist is a remote review track for evaluating AI outputs across domain contributor evaluation specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document...Remote workHourly payFor contractorsWork experience placement10 hours per week
- ...Overview We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project... ...increasingly handle complex workflows in this domain—specifically real-world customer... ...: Freelance / Independent Contractor Workplace Type: Remote #J-18808-Ljbffr...Remote workHourly payFor contractorsFreelance
Invisible Technologies Inc. Defunct
New York, NY17 hours ago - ...role Meridial seeks independent Audio Evaluation Specialists for an AI benchmark evaluation project. You... ...across travel, finance, and technical domains. What you'll do Design and execute complex... ...do not apply Work environment is remote; no office required #J-18808-Ljbffr...Remote workHourly payFor contractorsFreelanceWork at officeWorldwide
remote work
New York, NY17 hours ago $60 per hour
Prolific is seeking Computer Science Specialists to join our Expert Network to train and evaluate AI models. You’ll complete a quick 10- to 15-minute test and, if... ...depending on skills and experience. This role offers remote work and the opportunity to contribute to high‑...Remote jobWork from homeFlexible hours$21 - $35 per hour
Crossing Hurdles is seeking an Image Evaluation Expert (Visual Arts / Photography) on a remote contract basis. You will upload photos, compare AI-generated images with real photographs, and assess lighting, perspective, and textures to ensure visual accuracy. You will...Remote jobHourly payContract work- Crossing Hurdles is seeking an Image Evaluation Expert for a remote contract role in the United States. You will upload photographs, compare real images with AI outputs, and assess lighting, perspective, and textures to ensure accuracy. You will provide clear, evidence-...Remote jobContract work10 hours per week
- ...journalism or technology design tough, domain-specific tasks meant to expose reasoning flaws in AI models. They write demanding... ...training, annotation, RLHF or evaluation Preferred: deep expertise in... ...listing does not state a rate. Where: Remote, no country limit stated. Time:...Remote workContract work
- ...Remote Video Production Specialist — AI Evaluation Work is a remote evaluation track for reviewing video production evaluation prompts and responses against... ...inter-rater agreement metrics and calibration cycles. Domain expertise that lets you spot subject-matter errors...Remote jobHourly payFor contractors10 hours per week
$30 - $50 per hour
AI Privacy, Safety And Evaluation Specialist Test personal AI agents and review responses for privacy risks in a six-week, part-time U.S. project paying $30 to $50 per hour. Remote Hourly · $30-$50/hr $30-$50/hr Compensation Contract, part-time Engagement Remote...Remote workHourly payContract workPart timeFor contractorsFlexible hours- Role Title: Evaluation Specialist/Recent Grad Role Type: Contractor Location: Remote our partner is engaging Evaluation Specialists/Recent... ...to help train next-generation AI systems. Your work will shape... ...experience in AI is required — your domain knowledge is what matters....Remote workContract workFor contractorsWorldwide
$30 - $60 per hour
...Role Title: Domain Contributor - Evaluation Specialist Role Type: Contractor (~15 hrs/week) Location: Remote micro1 is engaging Domain Contributor - Evaluation Specialists to... ...project evaluating and improving advanced AI models. In this role, you'll apply your expertise...Remote workContract workFor contractorsFlexible hours$8 - $65 per hour
Philosophy Specialist - Freelance AI Trainer Project United States of America Are you a philosophy expert... ...to our prompt engineering and evaluation metrics. A master’s or PhD in philosophy... ...type: Contract Workplace type: Remote Seniority level: Mid‑Senior Level Apply...Remote jobHourly payContract workFor contractorsFreelanceImmediate start$21 - $35 per hour
...standards Compare your original images with the AI-generated versions Spot imperfections,... ...artifacts to composition problems Fully remote and flexible, no fixed shifts, no commute... ...No AI experience needed. Experience evaluating AI-generated images, annotating visual...Remote jobHourly payPart timeFor contractorsFlexible hours- Specialist - S&P - Procurement Ops Ready to turn bold ideas into real-world impact? At... ...adapt to change, we lead it. AI and digital innovation are... .... Conduct supplier evaluations, performance reviews, and... ...- S&P - Procurement Ops Remote Type - Remote Work Shift...Remote workContract workWork at officeShift workNight shift
- OpenTrain AI, Inc. is seeking an Employment and Labor Law AI Evaluation Expert to review AI-generated answers to U.S. employment law scenarios, assess legal accuracy... ..., and write feedback to improve models. This 100% remote, part-time freelance role requires a U.S. law...Remote jobPart timeFreelance
$30 per hour
Zekai is seeking a curious, clear writer to help evaluate AI assistants on realistic everyday tasks. You’ll craft short requests, interact... ...the results against a professional standard. This is a 100% remote contract in the United States, about 10 hours per week, paying...Remote jobHourly payContract work10 hours per weekFlexible hours- AuraOne is seeking an AI Agent Evaluator to remotely review and label ai agent evaluation prompts and responses against AuraOne's quality rubric. You will compare outputs, identify edge cases, and provide structured feedback to support retraining. The role focuses on auditing...Remote job
$30 - $40 per hour
211 Specialist, Government Services AI Evaluator Use your experience helping people find public benefits and community resources to evaluate AI answers,... ...This U.S.-based contract role pays $30 to $40 per hour. Remote Hourly · $30-$40/hr $30-$40/hr Compensation...Remote workHourly payContract workPart timeFor contractorsFlexible hours- Crossing Hurdles is seeking a detail-focused evaluator to design domain-specific AI assessment tasks and surface reasoning gaps. This contract role is remote, with 10-40 hours per week, ideal for researchers and experts who can verify claims against primary sources. You...Remote jobContract work10 hours per week
- Evaluate audio-based conversational AI in realistic customer support scenarios. Contribute to high-quality datasets for advanced AI models. Work remotely as a freelance independent contractor. Responsibilities: Design and conduct role-play scenarios across travel, finance...Remote jobHourly payFor contractorsFreelanceFlexible hours
- ...customer service role-plays in travel, finance, and tech support. Evaluate AI audio responses using structured criteria for accuracy,... ...compensation of $6-$65 based on experience and location. Fully remote freelance work with flexible scheduling. Meaningful impact on...Remote jobHourly payFreelanceFlexible hours
- AuraOne is seeking a Domain Researcher, Legal to remotely evaluate AI outputs used in legal review workflows. You will grade citations, assess statutory reasoning, and document corrected analyses for training the modeling team. Responsibilities include verifying authorities...Remote jobHourly payFor contractors
$80 - $150 per hour
...and technical talent with leading AI research labs. Headquartered in... ...: MS Excel / Google Sheets Evaluator Type: Contract Compensation... ...$80–$150/hour Location: Remote Role Responsibilities Review and assess domain-specific documents to ensure quality...Remote workContract workSummer work$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... ...Humanities / arts / culture Evaluator Type: Contract Compensation... ...$80–$120/hour Location: Remote Role Responsibilities... ...-generated artifacts against domain-specific quality rubrics. Identify...Remote workContract workSummer workWork at office$65 per hour
...Prolific is seeking registered nurses to join its Domain Expert pool to train and evaluate AI models. You will take a quick skills test and, if successful, be invited to join Prolific as a Domain Expert participant, earning payments for AI tasks. Researchers pay up...Remote workSelf employmentWork from homeFlexible hoursProlific Academic Ltd
United States5 days ago$120 per hour
...Prolific is seeking Licensed Pharmacists to train and evaluate AI models in Nashville, TN. As a Domain Expert, you'll review AI-generated pharmaceutical scenarios, ensuring accuracy and safety. Participants can earn up to $120 USD/hr based on skills and experience. The...Remote workWork from homeFlexible hoursProlific
United States5 days ago$90 - $150 per hour
...Clinical / Health Domain Expert (Part-Time | Remote | $90–$150/hr) Position: Clinical / Health Domain Expert... ...About the Opportunity A leading AI research project is seeking licensed... ...contribute clinical expertise to AI training, evaluation, and development. This is a W-2...Remote workHourly payPart timeWeekday workSynthires
United States7 hours ago$126.4k - $173.8k
...Role As an Infection Prevention Specialist, Peri-op , you will have the opportunity to tap... ...prerequisites to entry. Work location: Remote Sales Territory: Northern Virginia... ...company will be from an email with a domain of @solventum.com . Be wary of unsolicited...Remote workFull timeContract workH1bLocal areaRelocation packageFlexible hoursNight shift$120 per hour
...Prolific is seeking Licensed Pharmacists to join their Expert Network for AI training. As a Domain Expert, you will evaluate AI responses to pharmaceutical scenarios, offering your expertise for competitive pay of up to $120 USD/hr. Ideal candidates will have a current...Remote workWork from homeFlexible hoursProlific
United States5 days ago$80 - $150 per hour
...Prolific is seeking Medical Doctors to join as Domain Expert participants in training AI models. Responsibilities include evaluating AI responses for accuracy and writing feedback for improvement. A competitive pay of $80-$150 per hour based on skills is offered. Candidates...Remote workHourly payWork from homeProlific
Denver, CO3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Evaluation Specialist, AI Domain Ops. Be the first to apply!
Related searches
- live chat specialist New York, NY
- patient safety specialist New York, NY
- credit card specialist New York, NY
- senior specialist New York, NY
- zoning specialist New York, NY
- charge entry specialist New York, NY
- health program specialist New York, NY
- youth specialist New York, NY
- microsoft specialist New York, NY
- transportation specialist New York, NY