Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Operations Research Model Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

Operations Research Model Evaluator is a remote review track for evaluating AI outputs across operations research model research review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling team can train on it.

Why this role matters

Operations Research Model research review models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would — checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one.

Responsibilities

  • Review AI outputs against current operations research model research review methods, conventions, and prior work for Operations Research Model Evaluator assignments.
  • Reproduce or sanity-check key derivations, calculations, or experimental claims.
  • Flag dimensional, methodological, and citation errors with structured severity tags.
  • Capture the corrected reasoning or worked example so the modeling team can train on it.
  • Adjudicate disputed answers against textbooks, papers, or community standards.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Graduate-level training or equivalent applied experience in operations research model research review or a closely related field for Operations Research Model Evaluator work.
  • Hands-on experience publishing, teaching, or advising on the topic at a professional level.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites methods, papers, or worked examples.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Reproduce a operations research model research review derivation from a model output and flag any algebraic or dimensional errors.
  • Grade a model's literature summary against the cited papers and rate the citation quality.
  • Adjudicate a disputed answer between two reviewers using textbook methods.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

  • PhD, postdoc, or industry research experience in the topic area.
  • Prior work reviewing AI-assisted research tooling and its failure modes.
  • Multilingual fluency for non-English papers and corpora.

Skills

  • Scientific reasoning
  • Method validation
  • Citation review
  • Quantitative analysis
  • Operations Research Model research review
  • Formal reasoning
  • Proof review
  • Operations
  • Research

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Operations Research Model Evaluator [Remote] in Remote vacancy
  •  ...our clients' topline and streamline their operations. We specialize in providing tailored...  ...with EQT. Website: Linkedin Job Title: Evaluator - Political Science Location: Remote (USA...  ...Current: Stay updated with the latest research, guidelines, and advancements in your area... 
    Operations
    Contract work
    Remote work
    Worldwide

    Straive

    New York, NY
    1 day ago
  •  ...Refusal Preference Reward Model Evaluator is a remote red-team track for stress-testing AI systems...  ...red-teaming AI systems, security research, or adversarial ML work for Refusal Preference...  ...security, AppSec, or trust & safety operations. Experience publishing or... 
    Operations
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    8 days ago
  •  ...Role Overview Help evaluate frontier AI systems’ ability to distinguish...  ...technical scenarios, assess model responses, and define what...  ...experience is preferred. Operational health physics experience at...  ...Technical writing, published research, or expert witness experience... 
    Operations
    Remote work

    SaidGig

    United States
    4 days ago
  •  ...management, and network and facility operations. Bitdeer also offers advanced...  ...: every product built on a model is bounded by what it costs...  ...: ~ This role builds the evaluation and decision systems that...  ...token consumption. You will research and prototype adaptive model-... 
    Operations
    Full time

    Bitdeer Technologies Group

    Austin, TX
    18 days ago
  • $20 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...tools. Generate high-quality human evaluation data by identifying response strengths,...  ..., and completeness of responses. Ensure model responses align with expected conversational... 
    Suggested
    Remote job
    Contract work
    Part time
    Summer work

    Mercor

    New York, NY
    4 days ago
  • $79.4k - $119.1k

     ...development team environment as Project Lead on a mix of complex Full Model Change (FMC) and Minor Model Change (MMC) developments. Creates...  ...are kept. Manage the drawing creation process with Global Operations coordination. Coordinate with cross functional teams to... 
    Operations
    Full time
    Temporary work
    Work experience placement
    Work at office
    Remote work
    Relocation package

    Honda Dev. and Mfg. of Am.,LLC

    Raymond, OH
    22 days ago
  •  ...Research Interns at Applied Intuition Applied Intuition, Inc. is powering the future...  ...three core areas: tools and infrastructure, operating systems, and autonomy. Eighteen of the...  ...on pretraining world-action foundation model with various world modalities including... 
    Full time
    For contractors
    For subcontractor
    Casual work
    Internship
    Work at office
    Immediate start
    Remote work
    Day shift

    Applied Intuition

    Sunnyvale, CA
    2 days ago
  •  ...Marketing Technology Expert to support an AI training and evaluation project for enterprise marketing operations. You will test workflows and evaluate AI-generated...  ..., and analytics integrations; and documenting findings for AI model improvement. #J-18808-Ljbffr YO AI Labs
    Operations
    Remote job

    YO AI Labs

    Dallas, TX
    1 day ago
  • Obsidian is hiring expert Evaluators in Healthcare operations for a remote, hourly engagement. You will review AI-generated work products for accuracy, rigor, and domain quality, leveraging your extensive subject-matter expertise in the field. The ideal candidate has over... 
    Operations
    Remote job
    Hourly pay
    Work at office

    Obsidian

    San Francisco, CA
    1 day ago
  •  ...DESCRIPTION Build Your Future at DTCC As a Model Risk Management Intern, you will gain...  ...while learning how the financial markets operate behind the scenes. You will be part of a...  ...meetings, knowledge-sharing sessions, research efforts, ad hoc projects, and continuous... 
    Operations
    Hourly pay
    Full time
    Summer work
    Internship
    Summer internship
    Work at office
    Remote work

    DTCC

    Jersey City, NJ
    4 days ago
  • $47k - $49k

    Months Per Year: 12 Work Model: Onsite Seattle University will be...  ...Summary The Admissions Evaluator - International Credential Evaluations...  ...related to admissions operations for all undergraduate applicants...  ...Admissions Operations team and Research and Analytics. These tasks... 
    Operations
    Temporary work
    Work at office
    Flexible hours

    SU01 Seattle University

    Seattle, WA
    5 days ago
  • $65 per hour

    Prolific is seeking registered nurses in Las Vegas, NV, to assist in training AI models. You will review AI responses, rate their accuracy and safety, and write feedback to enhance AI learning. Candidates must be verified registered nurses, have recent clinical experience... 
    Hourly pay
    Self employment
    Work from home
    Flexible hours

    Prolific

    Las Vegas, NV
    3 days ago
  • $16 - $20 per hour

    JOB DESCRIPTION AND POSITION REQUIREMENTS The research team at Penn State Ross and Carol Nese College of Nursing is hiring part‑time research evaluators for projects focused on dementia care in assisted living settings. The research evaluator will assist with in‑person... 
    Hourly pay
    Part time
    Summer work

    The Pennsylvania State University

    Hershey, PA
    3 days ago
  • $40 - $100 per hour

     ...language work About AI Training and Scientific Evaluation AI training is the human side of...  ...artificial intelligence. Specialists review model responses, test reasoning, identify...  ...realistic scenarios, calculations, and research-style reasoning tasks. Focus on scientific... 
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    OpenTrain AI

    Brooklyn, NY
    4 days ago
  • $185k - $245k

     ...Enterprise Risk & Internal Audit department protects Affirm’s operations and long-term success. We identify, assess, and monitor risk across...  ...re looking for an intelligent, driven professional to join our Model Risk Management (MRM) team. This team seeks to establish,... 
    Operations
    Full time
    Work at office
    Remote work

    Affirm

    Remote
    9 days ago
  • $100k - $150k

     ...Large Language Model Specialist - Remote    Bright Vision Technologies...  ...dataset construction, rigorous evaluation methodology, and the engineering discipline to operate complex training pipelines...  ....  Collaborate with product, research, and platform teams to align... 
    Operations
    Full time
    H1b
    Local area
    Immediate start
    Remote work
    Visa sponsorship

    Bright Vision Technologies

    Eden Prairie, MN
    more than 2 months ago
  •  ...Job Title: Senior SAS/Python Model Validation and Modernization Developer Company:...  ...improve and enhance strategic and technical operations and deployments. Position Overview:...  ..., and business stakeholders to evaluate model performance, conduct what-if analyses... 
    Operations
    Full time
    Work at office
    Remote work

    BLN24

    McLean, VA
    more than 2 months ago
  •  ...As the Manager of Model Validation & Verification (VnV) for Behavior Autonomy, you will...  ...and data science team responsible for evaluating, benchmarking, and validating the machine...  ...pipelines that ensure our behavioral models operate safely, comfortably, and predictably.... 
    Operations
    Full time
    Temporary work
    Relocation package

    Zoox

    California
    4 days ago
  • YO AI Labs seeks experienced Specialized Industries Experts to evaluate AI-powered workflows across Government Contracting, Grants, Nonprofit operations, and EdTech. You will test AI agents in real-world scenarios and provide practical feedback to improve next-generation... 
    Operations
    Remote job

    YO AI Labs

    Los Angeles, CA
    1 day ago
  • Mercor is hiring expert Evaluators in Healthcare operations to review AI-generated outputs (documents, spreadsheets, and slide decks) for accuracy and domain quality. This is a remote, hourly engagement. You will apply deep subject-matter expertise to grade outputs, identify... 
    Operations
    Remote job
    Hourly pay

    Mercor

    New York, NY
    2 days ago
  •  ...Analytics is assembling a proposal team for a USTDA solicitation, focusing on air cargo, cold chain, ground handling and MRO operating models. The role is remote with possible travel and extended over a four-year contract, contingent on award. The ideal candidate brings... 
    Operations
    Remote job
    Contract work

    Axyde Analytics

    New York, NY
    1 day ago
  •  ...Vice President, Strategic Finance (R&D, Procurement & Corporate Model) About the Company Innovative AI-first SaaS company...  ...vertical saas ai-first applied ai vegetation management operations and maintenance utilities oil & gas power utilities... 
    Operations
    Remote work

    Confidential

    Palo Alto, CA
    2 days ago
  •  ...presenting complex document-related prompts and evaluating AI-generated deliverables. Create and...  ...-by-side preference data to inform AI model improvements, focusing on quality,...  ...cases reflecting functions like strategy, operations, sales, marketing, finance, or HR. Exceptional... 
    Operations
    Remote job
    Contract work
    Work at office

    YO IT Consulting

    Dallas, TX
    3 days ago
  • $60 - $80 per hour

     ...considered for remote, future contract opportunities supporting AI research in the physical sciences. Opportunities are matched to your...  ...labs and companies. Key Responsibilities Train and evaluate AI models in physical sciences. Create tasks and deliverables based... 
    Hourly pay
    Contract work
    For contractors
    Remote work

    SaidGig

    United States
    a month ago
  • $60 - $100 per hour

     ...hands-on preclinical drug-development expertise to help improve AI models for chemistry, materials science, and drug discovery. This...  ...pipeline. Participate in expert discussions, interviews, and research engagements. Work directly with the client team. Qualifications... 
    Hourly pay
    Part time
    Remote work
    10 hours per week

    SaidGig

    United States
    a month ago
  • $60 - $100 per hour

     ...hands-on preclinical drug development expertise to help improve AI models for chemistry, materials science, and drug discovery. This role...  .... Participate in expert discussions, interviews, and research engagements. Work directly with the client team. Qualifications... 
    Hourly pay
    Part time
    Remote work
    10 hours per week

    SaidGig

    United States
    a month ago
  • Bright Vision Technologies is seeking a Model Optimization Engineer to maximize throughput, reduce latency, and lower cost across training...  ...distributed systems, collaborating with product, design, and operations teams. The ideal candidate has strong Python and C++,... 
    Operations
    Remote job

    Bright Vision Technologies

    Round Rock, TX
    3 days ago
  • $90 - $120 per hour

     ...backgrounds. Create benchmark-quality responses for future model outputs and document the context and reasoning behind answers to...  ...scientific, technical, or educational statistics materials, such as research articles, curricula, industry reports, or peer reviews.... 
    Hourly pay
    For contractors
    Remote work

    SaidGig

    United States
    more than 2 months ago
  • $126k - $423k

     ...three core areas: tools and infrastructure, operating systems, and autonomy. Eighteen of the...  ...We are looking for multiple passionate Research Scientists to join the Research Group at...  ...on pretraining world-action foundation model with various world modalities including... 
    Full time
    For contractors
    For subcontractor
    Casual work
    Work at office
    Immediate start
    Remote work
    Day shift

    Applied Intuition

    California
    18 days ago
  • $60k - $70k

     ...Leave benefits Employee stock purchase plan Job Description Model Consultant - California, Hawaii & Las Vegas (Nevada) The Model...  ...guidance on practice management topics including scalability, operational efficiency, advisor productivity, and client acquisition. Collaborate... 
    Operations
    Full time
    Part time
    Work at office
    Home office
    Flexible hours

    Invesco

    Los Angeles, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Operations Research Model Evaluator [Remote]. Be the first to apply!