Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

STEM Explanation AI Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

STEM Explanation AI Evaluator is a remote review track for evaluating AI outputs across stem research reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling team can train on it.

Why this role matters

STEM research models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would — checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one.

Responsibilities

  • Review AI outputs against current stem research methods, conventions, and prior work for STEM Explanation AI Evaluator assignments.
  • Reproduce or sanity-check key derivations, calculations, or experimental claims.
  • Flag dimensional, methodological, and citation errors with structured severity tags.
  • Capture the corrected reasoning or worked example so the modeling team can train on it.
  • Adjudicate disputed answers against textbooks, papers, or community standards.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Graduate-level training or equivalent applied experience in stem research or a closely related field for STEM Explanation AI Evaluator work.
  • Hands-on experience publishing, teaching, or advising on the topic at a professional level.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites methods, papers, or worked examples.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Reproduce an stem research derivation from a model output and flag any algebraic or dimensional errors.
  • Grade a model's literature summary against the cited papers and rate the citation quality.
  • Adjudicate a disputed answer between two reviewers using textbook methods.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

  • PhD, postdoc, or industry research experience in the topic area.
  • Prior work reviewing AI-assisted research tooling and its failure modes.
  • Multilingual fluency for non-English papers and corpora.

Skills

  • Scientific reasoning
  • Method validation
  • Citation review
  • Quantitative analysis
  • STEM research
  • Learning design
  • Assessment review
  • Pedagogy
  • STEM
  • Explanation

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the STEM Explanation AI Evaluator [Remote] in Remote vacancy
  • $50 per hour

     ...experienced scientists/engineers fluent in German to train and evaluate AI agents on realistic professional tasks. You will build workspaces...  ...files, write prompts, and create grading rubrics based on real stem work as it's done in Germany. The role is remote, about 21... 
    Suggested
    Remote job
    Hourly pay

    Mercor

    New York, NY
    2 days ago
  •  ...Alignerr is seeking Search Quality Evaluators (AI Training) to assess search results, AI-generated answers, and recommendations. This...  ...ll evaluate relevance and accuracy, provide concise written explanations, and complete tasks at your own pace. No prior AI experience... 
    Suggested
    Hourly pay
    Contract work
    Remote work
    10 hours per week
    Flexible hours

    Alignerr Corp.

    United States
    4 days ago
  • Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will roleplay...  ...zooming in on outputs, rating across dimensions such as realism and accuracy, and writing clear explanations in #J-18808-Ljbffr Outlier
    Suggested
    Remote job
    Flexible hours

    Outlier

    Boca Raton, FL
    5 days ago
  • $8 - $65 per hour

    agency is seeking a remote contract contractor to evaluate and improve AI responses to coding tasks in Latin American Spanish. You will examine technical problem solving, verify explanations and code, and assess fluent, natural language usage. The role blends software... 
    Suggested
    Remote job
    Hourly pay
    Contract work
    For contractors

    agency

    New York, NY
    2 days ago
  •  ...Materials Science Specialists to join its Expert Network for AI training and evaluation. You’ll complete a short test and, if selected, contribute...  ...with a background in materials science or related STEM fields can earn competitive pay and have the flexibility to... 
    Suggested
    Work from home

    Prolific Academic Ltd

    New York, NY
    1 day ago
  • AI Trainer Jobs is seeking qualified professionals for a remote AI safety evaluation project focused on explosives and energetic materials. Tier 1 annotators review prompts and...  ...under contract terms. The role requires a STEM degree (Bachelor's/Master's) or higher for Tier... 
    Remote job
    Contract work

    Pasiflora AI LLC

    New York, NY
    4 days ago
  • $30 per hour

    Business Analyst, Educational Rater and Evaluator Review and improve AI-generated educational responses through research, fact checking, and clear written explanations. This remote US contractor project pays $30 per hour, requires 20 hours weekly, and allows up to 40 hours... 
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    3 days ago
  •  ...Energetic Materials Explosives Engineering AI Safety Hazmat Safety What this pays Rates...  ...stand behind. About the Role AI Safety Evaluation Project | Remote | Contract Locations: US...  ...Bachelor's or Master's degree in a relevant STEM or technical field. Relevant backgrounds... 
    Hourly pay
    Contract work
    For contractors
    Remote work

    Pasiflora AI LLC

    New York, NY
    3 days ago
  •  ...United States is seeking a senior Python developer to support AI training and evaluation through paid assignments. You’ll judge generated code and...  ...review Python code for correctness and quality, check explanations of algorithms for logical completeness, and identify #J-... 
    Remote job
    Flexible hours

    prolificacademicltd

    New York, NY
    2 days ago
  • $55 per hour

    OpenTrain AI, Inc. is seeking a part-time, remote contractor with advanced psychology...  ...to create domain-specific prompts and evaluate AI model responses for accuracy and clarity...  ...prompts to test knowledge, and assess explanations against established concepts. The role... 
    Remote job
    Hourly pay
    Part time
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    5 days ago
  • $18 - $45 per hour

     ...requirements Help Shape the Future of AI in Finance Are you a finance professional...  ...Experts (SMEs) to support a specialized AI evaluation pilot focused on the financial markets...  ..., bond market analyses, investment explanations, and related financial content for accuracy... 
    Extra income
    Temporary work
    For contractors
    Freelance
    Remote work
    Flexible hours

    Volga Partners

    New York, NY
    14 hours ago
  • prolificacademicltd is seeking an expert participant to review JavaScript and TypeScript code, evaluate explanations, and run scripts to assess behavior and performance. An initial skills assessment is required before joining the expert participant network. You will check... 
    Remote job
    Flexible hours

    prolificacademicltd

    New York, NY
    2 days ago
  • agency is seeking a contractor to evaluate AI-generated Rust solutions, probing model reasoning across systems topics and documenting...  ..., and secure coding practices while providing clear, written explanations. The role is remote in the United States with compensation on... 
    Remote job
    Hourly pay
    For contractors
    Freelance

    agency

    New York, NY
    2 days ago
  • OpenTrain AI, Inc. is seeking a remote contractor to review and improve AI-generated code, prompts, solutions, and explanations. The work blends programming judgment with multilingual technical communication and strict adherence to guidelines. The four-week assignment requires... 
    Remote job
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    5 days ago
  •  ...remote, hourly contractor role supporting AI data and language projects on a project-...  ...to support AI training datasets. LLM evaluation: reviewing AI-generated responses for accuracy...  ..., methodological errors, and unclear explanations even when language is fluent. Reliable,... 
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    CNTXT, Inc.

    New York, NY
    1 day ago
  • OpenTrain AI, Inc. is seeking a detail-oriented contractor to help evaluate AI systems by reviewing software code, technical documentation, and AI-generated answers...  ...several programming languages, write precise explanations, and provide actionable feedback to improve AI... 
    Remote job
    Contract work
    Part time
    For contractors
    Flexible hours

    OpenTrain AI, Inc.

    New York, NY
    5 days ago
  • AuraOne, Inc. is seeking a Digital Designer (AI Output Evaluation) contractor to remotely review AI-generated design outputs within established...  ...consistent rubric-based judgments, clear written explanations, and the ability to work asynchronously for at least 10 hours... 
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    New York, NY
    1 day ago
  • $30 per hour

     ...Review real user interaction traces with an AI shopping assistant Identify logical...  ...quality Commit to 20+ hours per week of evaluation work on our internal platform Who Should...  ...rendered. We are unable to support H1-B or STEM OPT candidates at this time. Pay: $30 #J... 
    Contract work
    For contractors
    Remote work

    Terac

    New York, NY
    5 days ago
  • $40 - $125 per hour

     ...that someone is you. As a Designer you'll evaluate how models reason about UX and visual...  ...actually is. What you’ll actually do Evaluate AI design work across user flows, layout,...  .... Clear written English: your explanations are the training signal. No degree required... 
    Full time
    Remote work
    Flexible hours

    DataAnnotation

    Atlanta, GA
    4 days ago
  •  ...TypeScript experience to review generated code and technical explanations, run scripts, and provide structured feedback on model performance...  ...before joining the expert participant network. You will evaluate correctness, clarity, and engineering quality, flag inefficiencies... 
    Remote job

    prolificacademicltd

    New York, NY
    2 days ago
  •  ...Seeking PhD-level quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content and contribute to the evaluation of advanced AI models in a flexible, remote contract role. Key Responsibilities Assessing the factuality... 
    Full time
    Contract work
    Remote work
    Flexible hours

    Virtual Vocations Inc

    United States
    3 days ago
  •  ...experienced software engineer to help evaluate the quality of interactions with modern...  ...Role Actually Is You will assess how AI coding agents behave in real-world scenarios...  ...would think Assess the quality of explanations and reasoning , not just code Distinguish... 
    Full time
    Contract work
    Temporary work

    G2i Inc.

    Remote
    19 days ago
  • $14.5 per hour

    A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical... 
    Hourly pay
    Part time
    Remote work
    Flexible hours

    Welo Data

    United States
    4 days ago
  • $14.5 per hour

     ...ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years...  ...we'd like you to join us! Job Description As a Web Search Evaluator, you will play a key role in improving the quality of search... 
    Part time
    Currently hiring
    Immediate start
    Remote work
    Work from home
    10 hours per week
    Flexible hours

    Jobs for Humanity

    United States
    5 days ago
  •  ...Alignerr Corp. is seeking Creative Writing Evaluators to shape AI training by judging AI-generated writing across fiction, poetry, essays, and more. You will provide structured feedback on style, voice, coherence, and reader engagement. Work is fully remote on an hourly... 
    Hourly pay
    Contract work
    Remote work
    10 hours per week

    Alignerr Corp.

    United States
    11 hours ago
  • $14.5 per hour

     ...AI Web Search Evaluator Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years of experience in... 
    Bi-weekly pay
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    Flexible hours

    Welo Data

    United States
    2 days ago
  • $85 per hour

    OpenTrain AI, Inc. is seeking a Process Safety Engineer AI Training Evaluator to review AI-generated content on environmental health and safety, process safety, and energy compliance. This remote, flexible project pays up to $85 per hour and requires strong written communication... 
    Remote job
    Hourly pay
    Flexible hours

    OpenTrain AI, Inc.

    New York, NY
    3 days ago
  • Outlier, operated by Scale AI, is seeking detail-oriented English speakers to review AI-generated media from home. You will roleplay live conversations with an AI voice model and rate outputs, then explain issues in writing for continuous model improvement. You can set... 
    Remote job
    Weekly pay
    Freelance
    Flexible hours

    Outlier (by Scale AI)

    New York, NY
    3 days ago
  •  ...Development Expert for a remote contractor role focused on an internal AI training project. You will bring your sales experience to shape...  ...feedback through written and verbal communication. You will evaluate AI interview scenarios, simulate conversations across industries... 
    Remote job
    For contractors

    Remotebridge

    New York, NY
    3 days ago
  • micro1 Inc. is seeking a Gmail & Google Calendar AI Assistant Evaluator. You will perform everyday digital tasks and coordinate scheduling using AI tools, remotely, on a contractor basis. Your role focuses on evaluating assistant performance and providing actionable feedback... 
    Remote job
    For contractors

    micro1 Inc.

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to STEM Explanation AI Evaluator [Remote]. Be the first to apply!