Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Operations Research Model Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

Operations Research Model Evaluator is a remote review track for evaluating AI outputs across operations research model research review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling team can train on it.

Why this role matters

Operations Research Model research review models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would — checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one.

Responsibilities

  • Review AI outputs against current operations research model research review methods, conventions, and prior work for Operations Research Model Evaluator assignments.
  • Reproduce or sanity-check key derivations, calculations, or experimental claims.
  • Flag dimensional, methodological, and citation errors with structured severity tags.
  • Capture the corrected reasoning or worked example so the modeling team can train on it.
  • Adjudicate disputed answers against textbooks, papers, or community standards.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Graduate-level training or equivalent applied experience in operations research model research review or a closely related field for Operations Research Model Evaluator work.
  • Hands-on experience publishing, teaching, or advising on the topic at a professional level.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites methods, papers, or worked examples.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Reproduce an operations research model research review derivation from a model output and flag any algebraic or dimensional errors.
  • Grade a model's literature summary against the cited papers and rate the citation quality.
  • Adjudicate a disputed answer between two reviewers using textbook methods.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

  • PhD, postdoc, or industry research experience in the topic area.
  • Prior work reviewing AI-assisted research tooling and its failure modes.
  • Multilingual fluency for non-English papers and corpora.

Skills

  • Scientific reasoning
  • Method validation
  • Citation review
  • Quantitative analysis
  • Operations Research Model research review
  • Formal reasoning
  • Proof review
  • Operations
  • Research

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 21 days ago
Similar jobs that could be interesting for youBased on the Operations Research Model Evaluator [Remote] in Remote vacancy
  • $60 - $80 per hour

     ...Operations Research Model Prompt Evaluator is a remote review track for evaluating AI outputs across operations research model prompt research review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and... 
    Operations
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    21 days ago
  • $185.8k - $312.4k

     ...us build out a foundational model that leverages a representation...  ...new field and an open-ended research effort. You will partner with...  ...modeling, market simulation and evaluation) and with product,...  ...you're working in tech, sales, operations, or design, you’ll be part of... 
    Operations
    Permanent employment
    Full time
    Live in
    Work at office
    Local area
    Remote work

    Zillow

    Remote
    9 days ago
  • Mercor Operations is seeking a board-certified radiologist (MD or DO) to evaluate health AI models. You will read de-identified patient charts and judge AI-provided radiology answers for clinical accuracy. This is a fully remote, part-time, hourly role open to qualified... 
    Operations
    Remote job
    Hourly pay
    Part time
    For contractors

    Remolity, Inc.

    New York, NY
    3 days ago
  •  ...our clients' topline and streamline their operations. We specialize in providing tailored...  ...with EQT. Website: Linkedin Job Title: Evaluator - Political Science Location: Remote (USA...  ...Current: Stay updated with the latest research, guidelines, and advancements in your area... 
    Operations
    Contract work
    Remote work
    Worldwide

    Straive

    New York, NY
    1 day ago
  • $160k - $200k

     ...Engineering and Sciences Subcategory: Modeling/Sim Engr Schedule: Full-Time...  ...wargaming and experimentation to create operational concepts and Force Design guidance for...  ...execution coordination, and analysis results evaluation. Recommend and document force design... 
    Operations
    Full time
    Remote work
    Shift work

    SAIC

    Colorado Springs, CO
    4 days ago
  •  ...Refusal Preference Reward Model Evaluator is a remote red-team track for stress-testing AI systems...  ...red-teaming AI systems, security research, or adversarial ML work for Refusal Preference...  ...security, AppSec, or trust & safety operations. Experience publishing or... 
    Operations
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    21 days ago
  • $15 per hour

     ...wrong Hold live conversations with AI voice models, compare image and video pairs, and explain what...  ...systems reason, learn, and improve. Through Outlier’s evaluation and feedback loop, your work helps turn frontier research into AI that performs better in the real world.... 
    Weekly pay
    Contract work
    Freelance
    Internship
    Remote work
    Flexible hours

    Outlier

    Chattanooga, TN
    8 hours ago
  • $15 per hour

     ...Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, rank outputs, and explain what looked or sounded off, all remotely and on your own schedule. You’ll review image and video pairs, assess... 
    Weekly pay
    Remote work
    Work from home
    Flexible hours

    Outlier

    Florida
    8 hours ago
  •  ...Outlier is recruiting detail-oriented English speakers to evaluate AI-generated media fully remotely, on a flexible schedule. You will engage in live conversations with AI voice models, score exchanges, compare AI-generated images and videos, and describe what looked... 
    Contract work
    Freelance
    Remote work
    Flexible hours

    Outlier

    Rockville, MD
    8 hours ago
  • $15 per hour

     ...Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and write concise explanations of what looked off, all remotely and on your own schedule. Work from... 
    Hourly pay
    Weekly pay
    Remote work
    Work from home
    Flexible hours

    Outlier

    Fresno, CA
    8 hours ago
  • $15 per hour

     ...Outlier is seeking detail-oriented English speakers to review AI-generated media. Hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, remotely and on your own schedule. Earn up to $15 USD/hr, with weekly payments and flexible... 
    Weekly pay
    Freelance
    Remote work
    Work from home
    Flexible hours

    Outlier

    New Haven, CT
    8 hours ago
  •  ...oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You’ll hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, all on your own timetable. You’ll rate accuracy and realism across... 
    Hourly pay
    Weekly pay
    Freelance
    Remote work
    Flexible hours

    Outlier

    Sioux Falls, SD
    8 hours ago
  •  ...fully remote, flexible schedule. You will roleplay with AI voice models, score exchanges, and explain in writing what looked off,...  ...improve AI reasoning and performance. Responsibilities include evaluating images, videos, and audio against prompts, and providing concise... 
    Weekly pay
    Contract work
    Freelance
    Remote work
    Flexible hours

    Outlier

    San Luis Obispo, CA
    8 hours ago
  •  ...Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare outputs, and explain what’s off, all remotely on your own schedule. You'll rate accuracy across prompts, visuals, and audio... 
    Weekly pay
    Freelance
    Remote work
    Flexible hours

    Outlier

    Tallahassee, FL
    8 hours ago
  •  ...Outlier is seeking detail-oriented English speakers to review AI-generated media. You’ll hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, all from home and on your own schedule. This freelance 1099 role offers flexible... 
    Weekly pay
    Freelance
    Remote work
    Flexible hours

    Outlier

    Grand Rapids, MI
    8 hours ago
  •  ...generated media by conducting live conversations with AI voice models and comparing outputs for prompt adherence. You’ll rank and describe...  ...supports advancing AI systems in practical settings. You’ll evaluate images, videos, and audio, writing concise explanations in... 
    Remote work
    Flexible hours

    Outlier

    Providence, RI
    8 hours ago
  • $15 per hour

     ...generated media. You will hold live conversations with AI voice models, compare image and video pairs, and explain in writing what...  ...leading LLMs, and opportunities to earn up to $15 per hour plus incentives as part of Outlier’s evaluation feedback loop. #J-18808-Ljbffr
    Hourly pay
    Weekly pay
    Remote work
    Work from home
    Flexible hours

    Outlier

    Corvallis, OR
    8 hours ago
  •  ...roleplay live conversations with AI voice models and score exchanges, compare AI-...  ...your own schedule. As part of Outlier's evaluation loop, your feedback helps shape how advanced...  ...reason, learn, and improve, turning frontier research into real-world #J-18808-Ljbffr
    Remote work

    Outlier

    Davis, CA
    8 hours ago
  • $15 per hour

     ...Outlier offers a remote, flexible, freelance opportunity to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, all on your own schedule. This role helps shape how advanced AI systems... 
    Weekly pay
    Freelance
    Remote work
    Flexible hours

    Outlier

    Cape Coral, FL
    8 hours ago
  •  ...Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, all remotely and on a flexible schedule. Responsibilities include holding... 
    Remote work
    Flexible hours

    Outlier

    Burlington, VT
    8 hours ago
  •  ...Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with an AI voice model, score exchanges, and explain what looked or sounded off, all remotely and on your own schedule. Responsibilities include comparing... 
    Contract work
    Freelance
    Remote work
    Flexible hours

    Outlier

    Ames, IA
    8 hours ago
  • $15 per hour

     ...Outlier is seeking contributors to review AI-generated media by holding live conversations with AI voice models, comparing image and video outputs, and explaining what’s off. Work remotely on a flexible schedule, with pay up to $15 per hour and weekly payments in several... 
    Hourly pay
    Weekly pay
    Remote work
    Flexible hours

    Outlier

    West Lafayette, IN
    8 hours ago
  •  ...Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and write explanations in English about what looked or sounded off. Work remotely on your own schedule, with... 
    Weekly pay
    Freelance
    Remote work
    Flexible hours

    Outlier

    Birmingham, AL
    8 hours ago
  •  ...Outlier is seeking detail-oriented English speakers to review AI-generated media by holding live conversations with AI voice models, scoring exchanges, and comparing image/video pairs to judge adherence to prompts. You will explain what looked or sounded off, all remotely... 
    Remote work
    Work from home
    Flexible hours

    Outlier

    Akron, OH
    8 hours ago
  •  ...Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models and score each exchange, compare generated images and videos to judge which follows the prompt better, and explain in writing what... 
    Remote work
    Flexible hours

    Outlier

    Rochester, NY
    8 hours ago
  • $15 per hour

     ...Outlier is seeking detail-oriented reviewers to evaluate AI-generated media. You will engage in live conversations with AI voice models, compare image and video outputs, and explain what is off with written notes. This remote role offers flexible hours and a pay rate up... 
    Hourly pay
    Weekly pay
    Remote work
    Work from home
    Flexible hours

    Outlier

    Saint Paul, MN
    8 hours ago
  • $15 per hour

     ...Outlier is hiring remote evaluators to review AI-generated media and rate how well outputs follow prompts. You will conduct live conversations with AI voice models, compare image and video pairs, and explain in writing what went off. This is a flexible, remote, 1099 contract... 
    Hourly pay
    Weekly pay
    Contract work
    Remote work
    Flexible hours

    Outlier

    Madison, WI
    8 hours ago
  •  ...review AI-generated media through live conversations with AI voice models. You will compare image and video pairs, judge which adheres to...  ...-world use. Responsibilities include assessing conversations, evaluating media quality, and providing concise explanations. #J-18808-... 
    Remote job

    Outlier

    Scottsdale, AZ
    1 day ago
  • $15 per hour

    Outlier invites you to join a remote, on-demand role where you evaluate AI-generated media. You’ll engage in live conversations with voice models, compare outputs, and write concise explanations on what went wrong, all from your preferred location and schedule. The position... 
    Remote job
    Hourly pay
    Weekly pay
    Flexible hours

    Outlier

    Arlington, VA
    1 day ago
  • Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, all remotely and on your own schedule. Contributors help shape how advanced AI... 
    Remote job
    Hourly pay
    Freelance
    Flexible hours

    Outlier

    Detroit, MI
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Operations Research Model Evaluator [Remote]. Be the first to apply!