Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Operations Research Model Prompt Evaluator [Remote]

$60 - $80 per hour

AuraOne Human Data

Remote
  • Remote job

Operations Research Model Prompt Evaluator is a remote review track for evaluating AI outputs across operations research model prompt research review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling team can train on it.

Why this role matters

Operations Research Model Prompt research review models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would — checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one.

Responsibilities

  • Review AI outputs against current operations research model prompt research review methods, conventions, and prior work for Operations Research Model Prompt Evaluator assignments.
  • Reproduce or sanity-check key derivations, calculations, or experimental claims.
  • Flag dimensional, methodological, and citation errors with structured severity tags.
  • Capture the corrected reasoning or worked example so the modeling team can train on it.
  • Adjudicate disputed answers against textbooks, papers, or community standards.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Graduate-level training or equivalent applied experience in operations research model prompt research review or a closely related field for Operations Research Model Prompt Evaluator work.
  • Hands-on experience publishing, teaching, or advising on the topic at a professional level.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites methods, papers, or worked examples.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Reproduce an operations research model prompt research review derivation from a model output and flag any algebraic or dimensional errors.
  • Grade a model's literature summary against the cited papers and rate the citation quality.
  • Adjudicate a disputed answer between two reviewers using textbook methods.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

  • PhD, postdoc, or industry research experience in the topic area.
  • Prior work reviewing AI-assisted research tooling and its failure modes.
  • Multilingual fluency for non-English papers and corpora.

Skills

  • Scientific reasoning
  • Method validation
  • Citation review
  • Quantitative analysis
  • Operations Research Model Prompt research review

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

$60–$80 / hr

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 21 days ago
Similar jobs that could be interesting for youBased on the Operations Research Model Prompt Evaluator [Remote] in Remote vacancy
  •  ...topline and streamline their operations. We specialize in providing tailored...  ...: Linkedin Job Title: Evaluator - Political Science Location:...  ...question posed in the user prompt. The goal is to assess quality...  ...Stay updated with the latest research, guidelines, and advancements... 
    Operations
    Contract work
    Remote work
    Worldwide

    Straive

    New York, NY
    1 day ago
  •  ...Refusal Preference Reward Model Evaluator is a remote red-team track for...  ...systems against adversarial prompts. Reviewers craft attack scenarios...  ...AI systems, security research, or adversarial ML work for...  ..., AppSec, or trust & safety operations. Experience publishing or... 
    Operations
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    21 days ago
  • $185.8k - $312.4k

     ...us build out a foundational model that leverages a representation...  ...new field and an open-ended research effort. You will partner with...  ...modeling, market simulation and evaluation) and with product,...  ...you're working in tech, sales, operations, or design, you’ll be part of... 
    Operations
    Permanent employment
    Full time
    Live in
    Work at office
    Local area
    Remote work

    Zillow

    Remote
    9 days ago
  • Mercor Operations is seeking a board-certified radiologist (MD or DO) to evaluate health AI models. You will read de-identified patient charts and judge AI-provided radiology answers for clinical accuracy. This is a fully remote, part-time, hourly role open to qualified... 
    Operations
    Remote job
    Hourly pay
    Part time
    For contractors

    Remolity, Inc.

    New York, NY
    3 days ago
  • $15 per hour

     ...live conversations with AI voice models, compare image and video pairs,...  ...to judge which follows the prompt better, and explain in writing...  ...and improve. Through Outlier's evaluation and feedback loop, your work helps turn frontier research into AI that performs better in... 
    Suggested
    Weekly pay
    Contract work
    Freelance
    Internship
    Remote work
    Flexible hours

    Outlier

    Charleston, WV
    10 hours ago
  •  ...conversations with AI voice models and score exchanges, compare...  ...videos to judge which follows prompts more accurately, and explain...  ...schedule. As part of Outlier's evaluation loop, your feedback helps...  ...and improve, turning frontier research into real-world #J-18808-Ljbffr
    Remote work

    Outlier

    Davis, CA
    10 hours ago
  • $15 per hour

     ...generated media. You will hold live conversations with AI voice models, rank outputs, and explain what looked or sounded off, all...  ...schedule. You’ll review image and video pairs, assess adherence to prompts, and describe issues with evidence-based explanations. Earn... 
    Weekly pay
    Remote work
    Work from home
    Flexible hours

    Outlier

    Florida
    10 hours ago
  •  ...review AI-generated media. You will hold live conversations with AI voice models, compare outputs, and explain what’s off, all remotely on your own schedule. You'll rate accuracy across prompts, visuals, and audio, write concise explanations in English, and help... 
    Weekly pay
    Freelance
    Remote work
    Flexible hours

    Outlier

    Tallahassee, FL
    10 hours ago
  •  ...generated media by conducting live conversations with AI voice models and comparing outputs for prompt adherence. You’ll rank and describe how natural and...  ...advancing AI systems in practical settings. You’ll evaluate images, videos, and audio, writing concise explanations... 
    Remote work
    Flexible hours

    Outlier

    Providence, RI
    10 hours ago
  •  ...flexible schedule. You will roleplay with AI voice models, score exchanges, and explain in writing what looked...  ...reasoning and performance. Responsibilities include evaluating images, videos, and audio against prompts, and providing concise, evidence-based feedback.... 
    Weekly pay
    Contract work
    Freelance
    Remote work
    Flexible hours

    Outlier

    San Luis Obispo, CA
    10 hours ago
  • $15 per hour

     ...Outlier is hiring remote evaluators to review AI-generated media and rate how well outputs follow prompts. You will conduct live conversations with AI voice models, compare image and video pairs, and explain in writing what went off. This is a flexible, remote, 1099 contract... 
    Hourly pay
    Weekly pay
    Contract work
    Remote work
    Flexible hours

    Outlier

    Madison, WI
    10 hours ago
  •  ...English speakers to review AI-generated media by holding live conversations with AI voice models, scoring exchanges, and comparing image/video pairs to judge adherence to prompts. You will explain what looked or sounded off, all remotely on your own schedule. Contributors... 
    Remote work
    Work from home
    Flexible hours

    Outlier

    Akron, OH
    10 hours ago
  •  ...speakers to review AI-generated media. You will roleplay live conversations with AI voice models and score each exchange, compare generated images and videos to judge which follows the prompt better, and explain in writing what looked or sounded wrong, all remotely and on... 
    Remote work
    Flexible hours

    Outlier

    Rochester, NY
    10 hours ago
  •  ...generated media. You will hold live conversations with an AI voice model, score exchanges, and explain what looked or sounded off, all...  ...Responsibilities include comparing AI-generated images and videos to prompts, inspecting outputs for issues like distorted motion or text... 
    Contract work
    Freelance
    Remote work
    Flexible hours

    Outlier

    Ames, IA
    10 hours ago
  • $160k - $200k

     ...Engineering and Sciences Subcategory: Modeling/Sim Engr Schedule: Full-Time...  ...wargaming and experimentation to create operational concepts and Force Design guidance for...  ...execution coordination, and analysis results evaluation. Recommend and document force design... 
    Operations
    Full time
    Remote work
    Shift work

    SAIC

    Colorado Springs, CO
    4 days ago
  • AI Trainer Jobs is seeking a remote contractor to evaluate people ops / recruiting prompts and responses against a evolving quality rubric. You will compare model outputs, label edge cases, and provide structured feedback for retraining. Responsibilities include evaluating... 
    Remote job
    For contractors

    AuraOne

    New York, NY
    21 hours ago
  •  ...media through live conversations with AI voice models. You will compare image and video pairs, judge which adheres to prompts, and explain in writing what looked or...  ...Responsibilities include assessing conversations, evaluating media quality, and providing concise explanations... 
    Remote job

    Outlier

    Scottsdale, AZ
    1 day ago
  • $15 per hour

    Outlier is hiring detail-oriented reviewers to evaluate AI-generated media from the comfort of your...  ...will engage in live conversations with AI voice models, compare image and video outputs to determine which follows prompts better, and provide written explanations of issues... 
    Remote job
    Hourly pay
    Weekly pay
    Flexible hours

    Outlier

    Cambridge, MA
    1 day ago
  •  ...media. You will hold live conversations with AI voice models, compare image/video pairs, and explain what’s off,...  ...home or while traveling. Responsibilities include live demonstrations, evaluating outputs for realism and alignment with prompts, and #J-18808-Ljbffr Outlier
    Remote job
    Weekly pay
    Freelance

    Outlier

    Austin, TX
    1 day ago
  • $15 per hour

     ...training platform owned and operated by Scale AI. Outlier...  ...generating training data to evaluating the performance of models. About the opportunity: We...  ...to judge which follows the prompt better, and explain in writing...  ...work helps turn frontier research into AI that performs... 
    Remote job
    Hourly pay
    Contract work
    For contractors
    Work experience placement
    Freelance
    Internship
    Night shift

    Scale AI

    Anaheim, CA
    1 day ago
  • $15 per hour

     ...oriented English speakers to review AI-generated media and hold live conversations with AI voice models. You will compare image and video pairs, rate how well they follow prompts, and explain in writing what looked off, all from home on your own schedule. Responsibilities... 
    Remote job
    Hourly pay
    Flexible hours

    Outlier

    Naperville, IL
    1 day ago
  •  ...provide detailed written explanations of what’s off. You will roleplay live conversations with AI voice models, compare generated visuals, and evaluate outputs for prompt adherence and realism. This freelance, 1099 role is remote with flexible hours and weekly payments.... 
    Remote job
    Weekly pay
    Freelance
    Flexible hours

    Outlier

    Garland, TX
    1 day ago
  •  ...generated media on a fully remote, self-paced schedule. You will roleplay live conversations with AI voice models, score exchanges, compare generated images and videos for prompt adherence, and clearly explain what was off, all from home or while traveling. This freelance, 1099... 
    Remote job
    Weekly pay
    Freelance
    Flexible hours

    Outlier

    Boca Raton, FL
    1 day ago
  •  ...speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score exchanges, compare generated images and videos to judge adherence to prompts, and write explanations in English. Work remotely on your own schedule, with payments on... 
    Remote job
    Flexible hours

    Outlier

    Glendale, CA
    1 day ago
  • Outlier invites detail-oriented English speakers to evaluate AI-generated media remotely, holding live conversations with AI voice models and scoring exchanges. You will compare AI-produced images and videos to prompts, then explain in writing what looked off, all on... 
    Remote job
    Flexible hours

    Outlier

    Kansas City, MO
    1 day ago
  • Table Image Reasoning Model Evaluator is a remote evaluation track for reviewing table image reasoning model evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback... 
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    AuraOne, Inc.

    New York, NY
    1 day ago
  •  ...Job Description Job Title: Language Model Evaluator Job Summary We are seeking a Language...  ...collaborating with AI Engineers, Data Scientists, Prompt Engineers, and Product teams to enhance...  ...Contributions to AI evaluation research or open-source projects Key Performance... 
    Full time
    Remote work

    Ova Technologies

    New York, NY
    2 days ago
  •  ...network and facility operations. Bitdeer also offers advanced...  ...product built on a model is bounded by what it...  ...This role builds the evaluation and decision systems...  ...consumption. You will research and prototype adaptive...  ...calling, context windows, prompt caching, reasoning... 
    Operations
    Full time

    Bitdeer Technologies Group

    Austin, TX
    28 days ago
  •  ...profitable growth of the company. The Fit Model has an integral role in the product...  ...patterns, and retrieve or ship packages. Operate within Agenda. Meet all assigned dates and...  ...Fitting Schedules and Business Meetings promptly. Collaborate Effectively with Colleagues.... 
    Operations
    Contract work
    Part time
    Casual work
    Shift work

    Oxford Industries

    King of Prussia, PA
    3 days ago
  •  ..., hourly contractor role, you will evaluate AI-generated financial content and...  ...work directly improves how leading AI models handle financial information,...  ...across balance sheets, reports, and operational records Developing prompts and test cases that test AI performance... 
    Operations
    Remote job
    Hourly pay
    Full time
    For contractors

    CNTXT AI

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Operations Research Model Prompt Evaluator [Remote]. Be the first to apply!