Remote AI Evaluation & Feedback Specialist
Auraone
- Remote job
AuraOne is seeking remote evaluators to review exocentric video recorder outputs and judge them against our quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain the model. This contractor role emphasizes written reasoning and careful annotation to drive measurable improvements. Responsibilities include tagging unsafe content, maintaining calibration scores, and coordinating with the team on rubric updates. #J-18808-Ljbffr Auraone
- OpenTrain AI, Inc. is seeking an Employment and Labor Law AI Evaluation Expert to review AI-generated answers to U.S. employment law scenarios... ...legal accuracy and reasoning, and write feedback to improve models. This 100% remote, part-time freelance role requires a U.S...Remote jobPart timeFreelance
- AuraOne is seeking an AI Agent Evaluator to remotely review and label ai agent evaluation prompts and responses against AuraOne's quality rubric.... ...compare outputs, identify edge cases, and provide structured feedback to support retraining. The role focuses on auditing model...Remote job
$30 per hour
Zekai is seeking a curious, clear writer to help evaluate AI assistants on realistic everyday tasks. You’ll craft short requests, interact... ...the results against a professional standard. This is a 100% remote contract in the United States, about 10 hours per week, paying...Remote jobHourly payContract work10 hours per weekFlexible hours- AuraOne, Inc. seeks a Hindi Bilingual Expert for a remote evaluation track to review prompts and responses against the company quality rubric... ...paired outputs, label edge cases, and draft structured feedback for retraining. You will evaluate Hindi generalist outputs,...Remote job10 hours per week
- AuraOne is seeking a Mandarin Transcription Expert to remotely evaluate mandarin generalist prompts and responses. You will compare outputs, label edge cases, and create structured feedback for retraining the model. As an independent contractor, you will review tasks with...Remote jobFor contractors
$20 - $60 per hour
AI Question and Answer Evaluation Specialist Create research-backed questions and answers, test AI model responses, and improve evaluation content remotely for $20 to $60 per hour equivalent, paid per task.... ...improve content based on feedback. Write original questions...Remote workHourly payContract workPart timeFor contractors$21 - $35 per hour
Crossing Hurdles is seeking an Image Evaluation Expert (Visual Arts / Photography) on a remote contract basis. You will upload photos, compare AI-generated images with real photographs,... .... You will document findings in clear feedback, apply photography knowledge, and collaborate...Remote jobHourly payContract work- AI Trainer Jobs in the United States is seeking a Bilingual Writer - German (Germany) to remotely review German prompts and responses, score them against... ..., and provide structured feedback for retraining. You will... ...the modeling team. Prior evaluation or annotation experience...Remote jobFor contractorsFlexible hours
- Zekai in the United States is seeking AI Generalist Experts for a 100% remote contractor role. You will apply your problem-solving... ...with AI tools to complete real-world tasks, evaluate outputs, and provide structured feedback to improve AI models. The role involves executing...Remote jobFor contractors
- Crossing Hurdles is seeking an Image Evaluation Expert for a remote contract role in the United States. You... ..., compare real images with AI outputs, and assess lighting, perspective... ...provide clear, evidence-based written feedback, collaborate with other contributors,...Remote jobContract work10 hours per week
$30 - $50 per hour
AI Privacy, Safety And Evaluation Specialist Test personal AI agents and review responses for privacy risks in a... ...project paying $30 to $50 per hour. Remote Hourly · $30-$50/hr $30-$50/hr... ...and provide clear, evidence-based feedback. Apply privacy principles to complex...Remote workHourly payContract workPart timeFor contractorsFlexible hours- YO AI Labs seeks a former U.S. Consular Officer or Passport Specialist to evaluate AI-generated guidance on passport and citizenship matters. This remote, contractor role asks for 20-30 hours per week and... ...complex cases, and giving clear feedback to the team. #J-18808-...Remote jobFor contractors
- AuraOne is seeking a Conlang Language Expert to remotely review language evaluation prompts and responses against our quality rubric. You will compare... ...paired outputs, label edge cases, and write structured feedback used to retrain models. As a contractor, you will work...Remote jobFor contractors10 hours per weekFlexible hours
$30 - $40 per hour
211 Specialist, Government Services AI Evaluator Use your experience helping people find public benefits and community... ...write scoring guides, and give precise feedback. This U.S.-based contract role pays $30 to $40 per hour. Remote Hourly · $30-$40/hr $30-$40/hr...Remote workHourly payContract workPart timeFor contractorsFlexible hours- Meridial is seeking literature specialists to train and evaluate large language models. The... ...modes, and giving structured feedback to improve model reasoning and... ...prompts. This is a freelance, remote contract position focused on advancing AI understanding of world...Remote workContract workFreelanceWorldwide
- ...role Meridial seeks independent Audio Evaluation Specialists for an AI benchmark evaluation project. You... ...interactions Provide structured, detailed feedback and data for model optimization... ...do not apply Work environment is remote; no office required #J-18808-Ljbffr...Remote workHourly payFor contractorsFreelanceWork at officeWorldwide
$60 per hour
Prolific is seeking Computer Science Specialists to join our Expert Network to train and evaluate AI models. You’ll complete a quick 10- to 15-minute test and, if... ...depending on skills and experience. This role offers remote work and the opportunity to contribute to high‑...Remote jobWork from homeFlexible hours- AuraOne, Inc. is seeking a Domain Contributor Evaluation Specialist for a remote contractor role in the United States. You will review AI outputs against workflows, policy, and stakeholder-fit using a structured rubric, and document the next steps for model training. Responsibilities...Remote jobFor contractors10 hours per week
$41.6k
...Overview We are sourcing independent Search Engine Evaluation Specialists to provide their expertise for an AI benchmark evaluation project. As AI models... ...PTO do not apply. Engagement Type: Freelance / Independent Contractor Workplace Type: Remote...Remote workHourly payContract workFor contractorsFreelance$8 - $65 per hour
Philosophy Specialist - Freelance AI Trainer Project United States of America Are you a philosophy expert... ...to our prompt engineering and evaluation metrics. A master’s or PhD in philosophy... ...type: Contract Workplace type: Remote Seniority level: Mid‑Senior Level Apply...Remote jobHourly payContract workFor contractorsFreelanceImmediate start$21 - $35 per hour
...standards Compare your original images with the AI-generated versions Spot imperfections,... ...artifacts to composition problems Fully remote and flexible, no fixed shifts, no commute... ...No AI experience needed. Experience evaluating AI-generated images, annotating visual...Remote jobHourly payPart timeFor contractorsFlexible hours$70 - $120 per hour
Gridnaut Recruiting is hiring a remote Architectural & Interior Visualization Specialist (AI Evaluation) contractor (pay $70-$120/hr). Contribute to frontier AI research... ...elevations and renders and give clear, written feedback, catching problems with spatial logic,...Remote workContract workFor contractors- AuraOne, Inc. seeks a remote Historical Reasoning AI Evaluator to review prompts and responses, applying AuraOne's quality rubric. You will label edge cases, provide structured feedback, and inform retraining efforts through precise rationale. The role supports a contractor...Remote jobFor contractors
- AuraOne is seeking a remote AI Trainer & Evaluator contractor to review trainer prompts and responses against a quality rubric. You will compare outputs, label issues, and provide structured feedback to support model retraining. Responsibilities include evaluating model...Remote jobHourly payFor contractors
- AuraOne is seeking a Technical Writer to join a remote evaluation track. You will review prompts and responses against a quality rubric, providing structured feedback used to retrain the model. This is a contractor role with an hourly pay model, available to candidates...Remote jobHourly payFor contractors
- ...analytical thinkers to contribute to advanced AI research and evaluation projects. In this role, you will... ...provide structured, detailed written feedback to improve next-generation AI systems... ..., ability to work independently in a remote environment, and strict adherence to...Remote job
- ...Population Health Informaticist to join a remote, flexible hourly contract focused on training AI with public health data. You will evaluate AI-generated analyses for accuracy and... ...identify gaps, and provide clear, actionable feedback to improve model performance. The role...Remote workHourly payContract workFlexible hours
- AuraOne, Inc. is seeking a remote contractor to review Japanese generalist evaluation prompts and responses, applying AuraOne's quality rubric. You'll compare outputs, label issues, and generate structured feedback for model retraining. This role requires careful attention...Remote jobFor contractors10 hours per week
- AI Trainer is a remote evaluation track for reviewing AI trainer evaluation prompts and responses against AuraOne’s quality rubric. Reviewers compare... ...paired outputs, label edge cases, and write structured feedback for retraining the model. Responsibilities include...Remote jobHourly payFor contractorsFlexible hours
- Evaluate audio-based conversational AI in realistic customer support scenarios. Contribute to high-quality datasets for advanced AI models. Work remotely as a freelance independent contractor. Responsibilities: Design and conduct role-play scenarios across travel, finance...Remote jobHourly payFor contractorsFreelanceFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Evaluation & Feedback Specialist. Be the first to apply!
- ai data scientist New York, NY
- ai scientist New York, NY
- graphic design remote New York, NY
- remote scrum master New York, NY
- remote document review New York, NY
- remote recruiter New York, NY
- remote infrastructure engineer New York, NY
- genetic counselor remote New York, NY
- remote appointment scheduler New York, NY
- junior angular developer remote New York, NY
