Operations Research Model Prompt Evaluator [Remote]
$60 - $80 per hourAuraOne Human Data
- Remote job
Operations Research Model Prompt Evaluator is a remote review track for evaluating AI outputs across operations research model prompt research review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling team can train on it.
Why this role matters
Operations Research Model Prompt research review models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would — checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one.
Responsibilities
- Review AI outputs against current operations research model prompt research review methods, conventions, and prior work for Operations Research Model Prompt Evaluator assignments.
- Reproduce or sanity-check key derivations, calculations, or experimental claims.
- Flag dimensional, methodological, and citation errors with structured severity tags.
- Capture the corrected reasoning or worked example so the modeling team can train on it.
- Adjudicate disputed answers against textbooks, papers, or community standards.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
- Graduate-level training or equivalent applied experience in operations research model prompt research review or a closely related field for Operations Research Model Prompt Evaluator work.
- Hands-on experience publishing, teaching, or advising on the topic at a professional level.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that cites methods, papers, or worked examples.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Reproduce an operations research model prompt research review derivation from a model output and flag any algebraic or dimensional errors.
- Grade a model's literature summary against the cited papers and rate the citation quality.
- Adjudicate a disputed answer between two reviewers using textbook methods.
- Audit a 25-row batch for rubric consistency and report drift to the program lead.
Nice to have
- PhD, postdoc, or industry research experience in the topic area.
- Prior work reviewing AI-assisted research tooling and its failure modes.
- Multilingual fluency for non-English papers and corpora.
Skills
- Scientific reasoning
- Method validation
- Citation review
- Quantitative analysis
- Operations Research Model Prompt research review
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
$60–$80 / hr
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
- ...topline and streamline their operations. We specialize in providing tailored... ...: Linkedin Job Title: Evaluator - Political Science Location:... ...question posed in the user prompt. The goal is to assess quality... ...Stay updated with the latest research, guidelines, and advancements...OperationsContract workRemote workWorldwide
- ...Refusal Preference Reward Model Evaluator is a remote red-team track for... ...systems against adversarial prompts. Reviewers craft attack scenarios... ...AI systems, security research, or adversarial ML work for... ..., AppSec, or trust & safety operations. Experience publishing or...OperationsRemote jobHourly payFor contractors10 hours per week
$185.8k - $312.4k
...us build out a foundational model that leverages a representation... ...new field and an open-ended research effort. You will partner with... ...modeling, market simulation and evaluation) and with product,... ...you're working in tech, sales, operations, or design, you’ll be part of...OperationsPermanent employmentFull timeLive inWork at officeLocal areaRemote work- Mercor Operations is seeking a board-certified radiologist (MD or DO) to evaluate health AI models. You will read de-identified patient charts and judge AI-provided radiology answers for clinical accuracy. This is a fully remote, part-time, hourly role open to qualified...OperationsRemote jobHourly payPart timeFor contractors
$15 per hour
...live conversations with AI voice models, compare image and video pairs,... ...to judge which follows the prompt better, and explain in writing... ...and improve. Through Outlier's evaluation and feedback loop, your work helps turn frontier research into AI that performs better in...SuggestedWeekly payContract workFreelanceInternshipRemote workFlexible hours- ...conversations with AI voice models and score exchanges, compare... ...videos to judge which follows prompts more accurately, and explain... ...schedule. As part of Outlier's evaluation loop, your feedback helps... ...and improve, turning frontier research into real-world #J-18808-LjbffrRemote work
$15 per hour
...generated media. You will hold live conversations with AI voice models, rank outputs, and explain what looked or sounded off, all... ...schedule. You’ll review image and video pairs, assess adherence to prompts, and describe issues with evidence-based explanations. Earn...Weekly payRemote workWork from homeFlexible hours- ...review AI-generated media. You will hold live conversations with AI voice models, compare outputs, and explain what’s off, all remotely on your own schedule. You'll rate accuracy across prompts, visuals, and audio, write concise explanations in English, and help...Weekly payFreelanceRemote workFlexible hours
- ...generated media by conducting live conversations with AI voice models and comparing outputs for prompt adherence. You’ll rank and describe how natural and... ...advancing AI systems in practical settings. You’ll evaluate images, videos, and audio, writing concise explanations...Remote workFlexible hours
- ...flexible schedule. You will roleplay with AI voice models, score exchanges, and explain in writing what looked... ...reasoning and performance. Responsibilities include evaluating images, videos, and audio against prompts, and providing concise, evidence-based feedback....Weekly payContract workFreelanceRemote workFlexible hours
$15 per hour
...Outlier is hiring remote evaluators to review AI-generated media and rate how well outputs follow prompts. You will conduct live conversations with AI voice models, compare image and video pairs, and explain in writing what went off. This is a flexible, remote, 1099 contract...Hourly payWeekly payContract workRemote workFlexible hours- ...English speakers to review AI-generated media by holding live conversations with AI voice models, scoring exchanges, and comparing image/video pairs to judge adherence to prompts. You will explain what looked or sounded off, all remotely on your own schedule. Contributors...Remote workWork from homeFlexible hours
- ...speakers to review AI-generated media. You will roleplay live conversations with AI voice models and score each exchange, compare generated images and videos to judge which follows the prompt better, and explain in writing what looked or sounded wrong, all remotely and on...Remote workFlexible hours
- ...generated media. You will hold live conversations with an AI voice model, score exchanges, and explain what looked or sounded off, all... ...Responsibilities include comparing AI-generated images and videos to prompts, inspecting outputs for issues like distorted motion or text...Contract workFreelanceRemote workFlexible hours
$160k - $200k
...Engineering and Sciences Subcategory: Modeling/Sim Engr Schedule: Full-Time... ...wargaming and experimentation to create operational concepts and Force Design guidance for... ...execution coordination, and analysis results evaluation. Recommend and document force design...OperationsFull timeRemote workShift work- AI Trainer Jobs is seeking a remote contractor to evaluate people ops / recruiting prompts and responses against a evolving quality rubric. You will compare model outputs, label edge cases, and provide structured feedback for retraining. Responsibilities include evaluating...Remote jobFor contractors
- ...media through live conversations with AI voice models. You will compare image and video pairs, judge which adheres to prompts, and explain in writing what looked or... ...Responsibilities include assessing conversations, evaluating media quality, and providing concise explanations...Remote job
$15 per hour
Outlier is hiring detail-oriented reviewers to evaluate AI-generated media from the comfort of your... ...will engage in live conversations with AI voice models, compare image and video outputs to determine which follows prompts better, and provide written explanations of issues...Remote jobHourly payWeekly payFlexible hours- ...media. You will hold live conversations with AI voice models, compare image/video pairs, and explain what’s off,... ...home or while traveling. Responsibilities include live demonstrations, evaluating outputs for realism and alignment with prompts, and #J-18808-Ljbffr OutlierRemote jobWeekly payFreelance
$15 per hour
...training platform owned and operated by Scale AI. Outlier... ...generating training data to evaluating the performance of models. About the opportunity: We... ...to judge which follows the prompt better, and explain in writing... ...work helps turn frontier research into AI that performs...Remote jobHourly payContract workFor contractorsWork experience placementFreelanceInternshipNight shift$15 per hour
...oriented English speakers to review AI-generated media and hold live conversations with AI voice models. You will compare image and video pairs, rate how well they follow prompts, and explain in writing what looked off, all from home on your own schedule. Responsibilities...Remote jobHourly payFlexible hours- ...provide detailed written explanations of what’s off. You will roleplay live conversations with AI voice models, compare generated visuals, and evaluate outputs for prompt adherence and realism. This freelance, 1099 role is remote with flexible hours and weekly payments....Remote jobWeekly payFreelanceFlexible hours
- ...generated media on a fully remote, self-paced schedule. You will roleplay live conversations with AI voice models, score exchanges, compare generated images and videos for prompt adherence, and clearly explain what was off, all from home or while traveling. This freelance, 1099...Remote jobWeekly payFreelanceFlexible hours
- ...speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score exchanges, compare generated images and videos to judge adherence to prompts, and write explanations in English. Work remotely on your own schedule, with payments on...Remote jobFlexible hours
- Outlier invites detail-oriented English speakers to evaluate AI-generated media remotely, holding live conversations with AI voice models and scoring exchanges. You will compare AI-produced images and videos to prompts, then explain in writing what looked off, all on...Remote jobFlexible hours
- Table Image Reasoning Model Evaluator is a remote evaluation track for reviewing table image reasoning model evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback...Hourly payFor contractorsRemote work10 hours per week
- ...Job Description Job Title: Language Model Evaluator Job Summary We are seeking a Language... ...collaborating with AI Engineers, Data Scientists, Prompt Engineers, and Product teams to enhance... ...Contributions to AI evaluation research or open-source projects Key Performance...Full timeRemote work
- ...network and facility operations. Bitdeer also offers advanced... ...product built on a model is bounded by what it... ...This role builds the evaluation and decision systems... ...consumption. You will research and prototype adaptive... ...calling, context windows, prompt caching, reasoning...OperationsFull time
- ...profitable growth of the company. The Fit Model has an integral role in the product... ...patterns, and retrieve or ship packages. Operate within Agenda. Meet all assigned dates and... ...Fitting Schedules and Business Meetings promptly. Collaborate Effectively with Colleagues....OperationsContract workPart timeCasual workShift work
- ..., hourly contractor role, you will evaluate AI-generated financial content and... ...work directly improves how leading AI models handle financial information,... ...across balance sheets, reports, and operational records Developing prompts and test cases that test AI performance...OperationsRemote jobHourly payFull timeFor contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Operations Research Model Prompt Evaluator [Remote]. Be the first to apply!


