Theorem Proving Model Evaluator [Remote]
AuraOne Human Data
- Remote job
Theorem Proving Model Evaluator is a remote review track for evaluating AI outputs across theorem proving model research review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling team can train on it.
Why this role matters
Theorem Proving Model research review models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would — checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one.
Responsibilities
- Review AI outputs against current theorem proving model research review methods, conventions, and prior work for Theorem Proving Model Evaluator assignments.
- Reproduce or sanity-check key derivations, calculations, or experimental claims.
- Flag dimensional, methodological, and citation errors with structured severity tags.
- Capture the corrected reasoning or worked example so the modeling team can train on it.
- Adjudicate disputed answers against textbooks, papers, or community standards.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
- Graduate-level training or equivalent applied experience in theorem proving model research review or a closely related field for Theorem Proving Model Evaluator work.
- Hands-on experience publishing, teaching, or advising on the topic at a professional level.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that cites methods, papers, or worked examples.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Reproduce a theorem proving model research review derivation from a model output and flag any algebraic or dimensional errors.
- Grade a model's literature summary against the cited papers and rate the citation quality.
- Adjudicate a disputed answer between two reviewers using textbook methods.
- Audit a 25-row batch for rubric consistency and report drift to the program lead.
Nice to have
- PhD, postdoc, or industry research experience in the topic area.
- Prior work reviewing AI-assisted research tooling and its failure modes.
- Multilingual fluency for non-English papers and corpora.
Skills
- Scientific reasoning
- Method validation
- Citation review
- Quantitative analysis
- Theorem Proving Model research review
- Formal reasoning
- Proof review
- Theorem
- Proving
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
$15 per hour
...generated media gets wrong Hold live conversations with AI voice models, compare image and video pairs, and explain what’s off. Fully... ...AI systems reason, learn, and improve. Through Outlier’s evaluation and feedback loop, your work helps turn frontier research into...SuggestedWeekly payContract workFreelanceInternshipRemote workFlexible hours$15 per hour
...Outlier offers a remote, flexible, freelance opportunity to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, all on your own schedule. This role helps shape how advanced AI systems...SuggestedWeekly payFreelanceRemote workFlexible hours- ...generated media. You will roleplay live conversations with AI voice models and score exchanges, compare AI-generated images and videos to... ...all remotely and on your own schedule. As part of Outlier's evaluation loop, your feedback helps shape how advanced AI systems reason,...SuggestedRemote work
- ...Outlier is recruiting detail-oriented English speakers to evaluate AI-generated media fully remotely, on a flexible schedule. You will engage in live conversations with AI voice models, score exchanges, compare AI-generated images and videos, and describe what looked...SuggestedContract workFreelanceRemote workFlexible hours
$15 per hour
...Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, rank outputs, and explain what looked or sounded off, all remotely and on your own schedule. You’ll review image and video pairs, assess...SuggestedWeekly payRemote workWork from homeFlexible hours- ...oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You’ll hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, all on your own timetable. You’ll rate accuracy and realism across...Hourly payWeekly payFreelanceRemote workFlexible hours
$15 per hour
...Outlier is seeking detail-oriented English speakers to review AI-generated media. Hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, remotely and on your own schedule. Earn up to $15 USD/hr, with weekly payments and flexible...Weekly payFreelanceRemote workWork from homeFlexible hours$15 per hour
...Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and write concise explanations of what looked off, all remotely and on your own schedule. Work from...Hourly payWeekly payRemote workWork from homeFlexible hours- ...Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score exchanges, compare generated images and videos to judge adherence to prompts, and write explanations in English. Work...Remote workFlexible hours
- ...generated media by conducting live conversations with AI voice models and comparing outputs for prompt adherence. You’ll rank and describe... ...supports advancing AI systems in practical settings. You’ll evaluate images, videos, and audio, writing concise explanations in...Remote workFlexible hours
- ...fully remote, flexible schedule. You will roleplay with AI voice models, score exchanges, and explain in writing what looked off,... ...improve AI reasoning and performance. Responsibilities include evaluating images, videos, and audio against prompts, and providing concise...Weekly payContract workFreelanceRemote workFlexible hours
- ...Outlier is seeking detail-oriented English speakers to review AI-generated media. You’ll hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, all from home and on your own schedule. This freelance 1099 role offers flexible...Weekly payFreelanceRemote workFlexible hours
$15 per hour
...generated media. You will hold live conversations with AI voice models, compare image and video pairs, and explain in writing what... ...leading LLMs, and opportunities to earn up to $15 per hour plus incentives as part of Outlier’s evaluation feedback loop. #J-18808-LjbffrHourly payWeekly payRemote workWork from homeFlexible hours- ...flexible schedule. You will roleplay live conversations with AI voice models, score each exchange, and explain what looked or sounded off.... ...and includes access to leading LLMs. Responsibilities include evaluating image and video pairs, spotting issues such as distorted motion...Hourly payFreelanceRemote workFlexible hours
$15 per hour
...Outlier is hiring remote evaluators to review AI-generated media and rate how well outputs follow prompts. You will conduct live conversations with AI voice models, compare image and video pairs, and explain in writing what went off. This is a flexible, remote, 1099 contract...Hourly payWeekly payContract workRemote workFlexible hours- ...Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare images and videos, and explain what is off, all remotely and on your own schedule. At Outlier, your insights help shape...Contract workRemote workFlexible hours
- ...Outlier is seeking detail-oriented English speakers to review AI-generated media by holding live conversations with AI voice models, scoring exchanges, and comparing image/video pairs to judge adherence to prompts. You will explain what looked or sounded off, all remotely...Remote workWork from homeFlexible hours
$15 per hour
...Outlier is seeking contributors to review AI-generated media by holding live conversations with AI voice models, comparing image and video outputs, and explaining what’s off. Work remotely on a flexible schedule, with pay up to $15 per hour and weekly payments in several...Hourly payWeekly payRemote workFlexible hours- ...Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and write explanations in English about what looked or sounded off. Work remotely on your own schedule, with...Weekly payFreelanceRemote workFlexible hours
- ...Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, all remotely and on a flexible schedule. Responsibilities include holding...Remote workFlexible hours
- ...Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with an AI voice model, score exchanges, and explain what looked or sounded off, all remotely and on your own schedule. Responsibilities include comparing...Contract workFreelanceRemote workFlexible hours
- ...Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, compare image and video outputs for prompt adherence, and explain in writing what looked or sounded off, all...FreelanceRemote workFlexible hours
$15 per hour
...oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You'll hold live conversations with AI models, compare media pairs, and explain discrepancies in writing. Earn up to $15 per hour with weekly payments via ACH, PayPal, or AirTM....Hourly payWeekly payContract workRemote workFlexible hours- ...Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models and score each exchange, compare generated images and videos to judge which follows the prompt better, and explain in writing what...Remote workFlexible hours
$15 per hour
...Outlier is seeking detail-oriented reviewers to evaluate AI-generated media. You will engage in live conversations with AI voice models, compare image and video outputs, and explain what is off with written notes. This remote role offers flexible hours and a pay rate up...Hourly payWeekly payRemote workWork from homeFlexible hours- AI Trainer Jobs is seeking a remote contractor to evaluate people ops / recruiting prompts and responses against a evolving quality rubric. You will compare model outputs, label edge cases, and provide structured feedback for retraining. Responsibilities include evaluating...Remote jobFor contractors
- ...oriented English speakers to review AI-generated media remotely on a flexible schedule. You will conduct live conversations with AI voice models, compare AI-generated image and video pairs, and explain what’s off in writing, helping improve AI performance in real-world tasks....Remote jobFlexible hours
- ...oriented English speakers to review AI-generated media from home with flexible hours. You will hold live conversations with AI voice models, compare image/video pairs, and explain what’s off in writing. Paid on a 1099 basis, remote work across multiple countries, with...Remote jobWeekly payFlexible hours
- ...review AI-generated media through live conversations with AI voice models. You will compare image and video pairs, judge which adheres to... ...-world use. Responsibilities include assessing conversations, evaluating media quality, and providing concise explanations. #J-18808-...Remote job
$15 per hour
Outlier invites you to join a remote, on-demand role where you evaluate AI-generated media. You’ll engage in live conversations with voice models, compare outputs, and write concise explanations on what went wrong, all from your preferred location and schedule. The position...Remote jobHourly payWeekly payFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Theorem Proving Model Evaluator [Remote]. Be the first to apply!

