STEM Explanation AI Evaluator [Remote]
AuraOne Human Data
- Remote job
STEM Explanation AI Evaluator is a remote review track for evaluating AI outputs across stem research reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling team can train on it.
Why this role matters
STEM research models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would — checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one.
Responsibilities
- Review AI outputs against current stem research methods, conventions, and prior work for STEM Explanation AI Evaluator assignments.
- Reproduce or sanity-check key derivations, calculations, or experimental claims.
- Flag dimensional, methodological, and citation errors with structured severity tags.
- Capture the corrected reasoning or worked example so the modeling team can train on it.
- Adjudicate disputed answers against textbooks, papers, or community standards.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
- Graduate-level training or equivalent applied experience in stem research or a closely related field for STEM Explanation AI Evaluator work.
- Hands-on experience publishing, teaching, or advising on the topic at a professional level.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that cites methods, papers, or worked examples.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Reproduce an stem research derivation from a model output and flag any algebraic or dimensional errors.
- Grade a model's literature summary against the cited papers and rate the citation quality.
- Adjudicate a disputed answer between two reviewers using textbook methods.
- Audit a 25-row batch for rubric consistency and report drift to the program lead.
Nice to have
- PhD, postdoc, or industry research experience in the topic area.
- Prior work reviewing AI-assisted research tooling and its failure modes.
- Multilingual fluency for non-English papers and corpora.
Skills
- Scientific reasoning
- Method validation
- Citation review
- Quantitative analysis
- STEM research
- Learning design
- Assessment review
- Pedagogy
- STEM
- Explanation
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
$50 per hour
...experienced scientists/engineers fluent in German to train and evaluate AI agents on realistic professional tasks. You will build workspaces... ...files, write prompts, and create grading rubrics based on real stem work as it's done in Germany. The role is remote, about 21...SuggestedRemote jobHourly pay- ...Alignerr is seeking Search Quality Evaluators (AI Training) to assess search results, AI-generated answers, and recommendations. This... ...ll evaluate relevance and accuracy, provide concise written explanations, and complete tasks at your own pace. No prior AI experience...SuggestedHourly payContract workRemote work10 hours per weekFlexible hours
- Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will roleplay... ...zooming in on outputs, rating across dimensions such as realism and accuracy, and writing clear explanations in #J-18808-Ljbffr OutlierSuggestedRemote jobFlexible hours
$8 - $65 per hour
agency is seeking a remote contract contractor to evaluate and improve AI responses to coding tasks in Latin American Spanish. You will examine technical problem solving, verify explanations and code, and assess fluent, natural language usage. The role blends software...SuggestedRemote jobHourly payContract workFor contractors- ...Materials Science Specialists to join its Expert Network for AI training and evaluation. You’ll complete a short test and, if selected, contribute... ...with a background in materials science or related STEM fields can earn competitive pay and have the flexibility to...SuggestedWork from home
- AI Trainer Jobs is seeking qualified professionals for a remote AI safety evaluation project focused on explosives and energetic materials. Tier 1 annotators review prompts and... ...under contract terms. The role requires a STEM degree (Bachelor's/Master's) or higher for Tier...Remote jobContract work
$30 per hour
Business Analyst, Educational Rater and Evaluator Review and improve AI-generated educational responses through research, fact checking, and clear written explanations. This remote US contractor project pays $30 per hour, requires 20 hours weekly, and allows up to 40 hours...Hourly payContract workPart timeFor contractorsRemote work- ...Energetic Materials Explosives Engineering AI Safety Hazmat Safety What this pays Rates... ...stand behind. About the Role AI Safety Evaluation Project | Remote | Contract Locations: US... ...Bachelor's or Master's degree in a relevant STEM or technical field. Relevant backgrounds...Hourly payContract workFor contractorsRemote work
- ...United States is seeking a senior Python developer to support AI training and evaluation through paid assignments. You’ll judge generated code and... ...review Python code for correctness and quality, check explanations of algorithms for logical completeness, and identify #J-...Remote jobFlexible hours
$55 per hour
OpenTrain AI, Inc. is seeking a part-time, remote contractor with advanced psychology... ...to create domain-specific prompts and evaluate AI model responses for accuracy and clarity... ...prompts to test knowledge, and assess explanations against established concepts. The role...Remote jobHourly payPart timeFor contractors$18 - $45 per hour
...requirements Help Shape the Future of AI in Finance Are you a finance professional... ...Experts (SMEs) to support a specialized AI evaluation pilot focused on the financial markets... ..., bond market analyses, investment explanations, and related financial content for accuracy...Extra incomeTemporary workFor contractorsFreelanceRemote workFlexible hours- prolificacademicltd is seeking an expert participant to review JavaScript and TypeScript code, evaluate explanations, and run scripts to assess behavior and performance. An initial skills assessment is required before joining the expert participant network. You will check...Remote jobFlexible hours
- agency is seeking a contractor to evaluate AI-generated Rust solutions, probing model reasoning across systems topics and documenting... ..., and secure coding practices while providing clear, written explanations. The role is remote in the United States with compensation on...Remote jobHourly payFor contractorsFreelance
- OpenTrain AI, Inc. is seeking a remote contractor to review and improve AI-generated code, prompts, solutions, and explanations. The work blends programming judgment with multilingual technical communication and strict adherence to guidelines. The four-week assignment requires...Remote jobFor contractors
- ...remote, hourly contractor role supporting AI data and language projects on a project-... ...to support AI training datasets. LLM evaluation: reviewing AI-generated responses for accuracy... ..., methodological errors, and unclear explanations even when language is fluent. Reliable,...Hourly payFor contractorsRemote workFlexible hours
- OpenTrain AI, Inc. is seeking a detail-oriented contractor to help evaluate AI systems by reviewing software code, technical documentation, and AI-generated answers... ...several programming languages, write precise explanations, and provide actionable feedback to improve AI...Remote jobContract workPart timeFor contractorsFlexible hours
- AuraOne, Inc. is seeking a Digital Designer (AI Output Evaluation) contractor to remotely review AI-generated design outputs within established... ...consistent rubric-based judgments, clear written explanations, and the ability to work asynchronously for at least 10 hours...Remote jobFor contractors10 hours per week
$30 per hour
...Review real user interaction traces with an AI shopping assistant Identify logical... ...quality Commit to 20+ hours per week of evaluation work on our internal platform Who Should... ...rendered. We are unable to support H1-B or STEM OPT candidates at this time. Pay: $30 #J...Contract workFor contractorsRemote work$40 - $125 per hour
...that someone is you. As a Designer you'll evaluate how models reason about UX and visual... ...actually is. What you’ll actually do Evaluate AI design work across user flows, layout,... .... Clear written English: your explanations are the training signal. No degree required...Full timeRemote workFlexible hours- ...TypeScript experience to review generated code and technical explanations, run scripts, and provide structured feedback on model performance... ...before joining the expert participant network. You will evaluate correctness, clarity, and engineering quality, flag inefficiencies...Remote job
- ...Seeking PhD-level quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content and contribute to the evaluation of advanced AI models in a flexible, remote contract role. Key Responsibilities Assessing the factuality...Full timeContract workRemote workFlexible hours
- ...experienced software engineer to help evaluate the quality of interactions with modern... ...Role Actually Is You will assess how AI coding agents behave in real-world scenarios... ...would think Assess the quality of explanations and reasoning , not just code Distinguish...Full timeContract workTemporary work
$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...Hourly payPart timeRemote workFlexible hours$14.5 per hour
...ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years... ...we'd like you to join us! Job Description As a Web Search Evaluator, you will play a key role in improving the quality of search...Part timeCurrently hiringImmediate startRemote workWork from home10 hours per weekFlexible hours- ...Alignerr Corp. is seeking Creative Writing Evaluators to shape AI training by judging AI-generated writing across fiction, poetry, essays, and more. You will provide structured feedback on style, voice, coherence, and reader engagement. Work is fully remote on an hourly...Hourly payContract workRemote work10 hours per week
$14.5 per hour
...AI Web Search Evaluator Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years of experience in...Bi-weekly payHourly payPart timeImmediate startRemote workWork from homeFlexible hours$85 per hour
OpenTrain AI, Inc. is seeking a Process Safety Engineer AI Training Evaluator to review AI-generated content on environmental health and safety, process safety, and energy compliance. This remote, flexible project pays up to $85 per hour and requires strong written communication...Remote jobHourly payFlexible hours- Outlier, operated by Scale AI, is seeking detail-oriented English speakers to review AI-generated media from home. You will roleplay live conversations with an AI voice model and rate outputs, then explain issues in writing for continuous model improvement. You can set...Remote jobWeekly payFreelanceFlexible hours
- ...Development Expert for a remote contractor role focused on an internal AI training project. You will bring your sales experience to shape... ...feedback through written and verbal communication. You will evaluate AI interview scenarios, simulate conversations across industries...Remote jobFor contractors
- micro1 Inc. is seeking a Gmail & Google Calendar AI Assistant Evaluator. You will perform everyday digital tasks and coordinate scheduling using AI tools, remotely, on a contractor basis. Your role focuses on evaluating assistant performance and providing actionable feedback...Remote jobFor contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to STEM Explanation AI Evaluator [Remote]. Be the first to apply!

