Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Applied Biology Benchmark Specialist - AI Evaluation [Remote]

$60 - $75 per hour

AuraOne Human Data

Remote
  • Remote job

Applied Biology Benchmark Specialist - AI Evaluation is a remote review track for evaluating AI outputs across biology reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling team can train on it.

Why this role matters

Biology models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would — checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one.

Responsibilities

  • Review AI outputs against current biology methods, conventions, and prior work for Applied Biology Benchmark Specialist - AI Evaluation assignments.
  • Reproduce or sanity-check key derivations, calculations, or experimental claims.
  • Flag dimensional, methodological, and citation errors with structured severity tags.
  • Capture the corrected reasoning or worked example so the modeling team can train on it.
  • Adjudicate disputed answers against textbooks, papers, or community standards.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Graduate-level training or equivalent applied experience in biology or a closely related field for Applied Biology Benchmark Specialist - AI Evaluation work.
  • Hands-on experience publishing, teaching, or advising on the topic at a professional level.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites methods, papers, or worked examples.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Reproduce a biology derivation from a model output and flag any algebraic or dimensional errors.
  • Grade a model's literature summary against the cited papers and rate the citation quality.
  • Adjudicate a disputed answer between two reviewers using textbook methods.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

  • PhD, postdoc, or industry research experience in the topic area.
  • Prior work reviewing AI-assisted research tooling and its failure modes.
  • Multilingual fluency for non-English papers and corpora.

Skills

  • Scientific reasoning
  • Method validation
  • Citation review
  • Quantitative analysis
  • Biology

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

$60–$75 / hr

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Applied Biology Benchmark Specialist - AI Evaluation [Remote] in Remote vacancy
  •  ...French Audio Evaluations Specialist - Freelance AI Trainer Project World Wide - Remote Project Overview...  ...Audio Evaluation Specialists for an AI benchmark evaluation project assessing...  ...as health insurance and PTO do not apply. Engagement Type: Freelance / Independent... 
    Suggested
    Hourly pay
    For contractors
    Freelance
    Remote work

    Meridial

    United States
    1 day ago
  • $20 per hour

     ...Overview We are sourcing independent Search Engine Evaluation Specialists to provide their expertise for an AI benchmark evaluation project. As AI models increasingly...  ...such as health insurance and PTO do not apply. Engagement Type: Freelance / Independent... 
    Suggested
    Hourly pay
    Temporary work
    For contractors
    Freelance
    Remote work

    Meridial

    Remote
    3 days ago
  • $94 - $119 per hour

     ...Applied Health & Medicine Benchmark Specialist is a remote clinical-review track for evaluating AI outputs that touch clinical review. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected... 
    Suggested
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    2 days ago
  • ESR Healthcare is looking for a Robotics Evaluation Specialist to work remotely, applying expertise to train AI systems. This role includes executing physical actions on camera, evaluating robotic performance, and providing structured feedback. The ideal candidate should... 
    Suggested
    Remote job

    ESR Healthcare

    Palo Alto, CA
    2 days ago
  • $66 - $84 per hour

     ...Applied Computer Science Benchmark Specialist is a remote review track for evaluating AI outputs across applied computer science benchmark specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk... 
    Suggested
    Remote job
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    2 days ago
  •  ...Benchmark Regression Model Evaluation Specialist is a remote evaluation track for reviewing benchmark regression model...  .... Why this role matters AI data reviewers help turn benchmark...  ...Evaluation Specialist work. Comfort applying multi-page rubrics consistently across... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    13 days ago
  • $80 - $120 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ..., our investors include Benchmark , General Catalyst , Peter...  ...philanthropy / community programs Evaluator Type: Contract Compensation...  ...AI model outputs . Apply deep subject-matter expertise... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Atlanta, GA
    7 days ago
  •  ...25 applicants Get AI-powered advice on...  ...solid foundation in Biology, particularly at...  ...problem types with evaluation goals, especially...  ...defining new evaluation benchmarks based on Biology...  ...and encouraged to apply. Good research and...  ...for “Biology Specialist” roles. Biology Field... 
    Contract work
    Freelance
    Remote work

    Turing

    Boston, MA
    5 days ago
  • $60 - $90 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ..., our investors include Benchmark , General Catalyst , Peter...  ...cybersecurity topics. Evaluate and annotate model responses for...  ...handling of sensitive content. Apply structured guidelines to... 
    Full time
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    Remote
    1 day ago
  • $50 per hour

     ...Remote contract for PhDs in Biology, Biotechnology,...  ...edge projects with top AI labs while earning up to...  ...researchers to build better benchmarks. Responsibilities...  ...with rigorous logic. Evaluate AI outputs for accuracy...  ...agents; and second, by applying that expertise to help... 
    Remote job
    Contract work
    Flexible hours

    Turing

    San Francisco, CA
    4 days ago
  • $125 per hour

     ...Role Overview QGIS Specialists apply geographic information system and spatial analysis expertise to evaluate AI-generated spatial outputs, develop domain-specific prompts, and provide targeted feedback that improves AI understanding of GIS tasks and spatial data workflows... 
    Hourly pay
    Contract work
    Part time
    Work experience placement
    Remote work
    Flexible hours

    SaidGig

    United States
    8 days ago
  • $125 per hour

     ...Role Overview ParaView Specialists apply hands-on experience with scientific visualization, fluid dynamics simulation, and large dataset analysis to evaluate AI-generated outputs and guide AI systems to better understand computational science tasks and high-performance... 
    Hourly pay
    Full time
    Contract work
    Part time
    For contractors
    Remote work
    Flexible hours

    SaidGig

    United States
    3 days ago
  • Remote Biology Specialist (Master’s/PhD) - 34880 Remote Biology...  ...first 25 applicants Get AI-powered advice on this...  ...problem types with evaluation goals, especially in areas...  ...new evaluation benchmarks based on Biology curricula...  ...eligible and encouraged to apply. Ability to analyze... 
    Remote job
    Hourly pay
    Contract work
    Temporary work
    For contractors
    Freelance

    Turing

    New York, NY
    1 day ago
  • $60 - $90 per hour

     ...careful analysis, and convert discoveries into robust benchmark tasks used to strengthen model evaluation. Typical probes require one to two days of continuous...  ...in research, research engineering, security, or AI evaluation. Proven ability to identify vulnerabilities... 
    Hourly pay
    Full time
    Freelance
    Remote work

    SaidGig

    United States
    2 days ago
  • $1,750 - $2,150 per month

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam...  ...Role Responsibilities Review and evaluate AI-generated outputs related to threat analysis... 
    Hourly pay
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Remote
    1 day ago
  • $85 per hour

     ...Role Overview Pre-construction Managers apply hands-on energy project estimation, construction planning, and solar design expertise to evaluate AI-generated outputs and create expert training data that improves AI understanding of project development workflows and cost... 
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    SaidGig

    United States
    1 day ago
  • $35 - $65 per hour

    Pure Mathematics Specialist - Freelance AI Trainer Project World Wide - Remote...  ...day, you will construct and evaluate complex proofs, substantiate...  ...and mathematical reasoning benchmarks, enhancing the overall quality...  ...backbone of tomorrow’s AI? Apply today and help teach the... 
    Hourly pay
    Contract work
    For contractors
    Freelance
    Remote work

    Meridial

    New York, NY
    1 day ago
  • $11 - $30.65 per hour

    Spanish Audio Specialist - Freelance AI Trainer Project World Wide - Remote A project...  ...dedicated to assessing and benchmarking advanced agentic audio...  ...program’s mission is to evaluate and optimize model performance...  ...insurance and PTO do not apply. Job title: Spanish Audio... 
    Hourly pay
    Contract work
    For contractors
    Freelance
    Remote work

    Meridial

    New York, NY
    4 days ago
  • Dorado is seeking a Physics Specialist to contribute deep scientific expertise to AI model evaluation. You will craft and assess challenging physics problems, probe model reasoning at the frontier, and help identify where models fail under rigorous scientific scrutiny.... 
    Remote job

    Dorado

    New York, NY
    2 days ago
  •  ...Sciences; Nutrient Management Specialist Job no: 539654...  ...Categories: Biology/Life Science, Agricultural...  ...disability is needed to apply for this position, please...  ...as well as integrating AI and/or precision agriculture...  ...are required to be evaluated by a professional... 
    Permanent employment
    Temporary work
    Work at office
    Local area

    University of Florida

    Valley Park, MS
    2 days ago
  •  ...To support program evaluation and advanced analytics, the full-time Program Evaluation Specialist will lead the design and implementation of evaluations, utilizing quantitative...  ...research and evidence-based frameworks Apply advanced statistical methods to develop consistent... 
    Full time
    Remote work

    Virtual Vocations Inc

    United States
    2 days ago
  •  ...creativity will be rewarded.About the PositionThe Monitoring and Evaluation (M&E) Specialist will provide technical support to the Office of Monitoring...  ...will you? If you are passionate about this opportunity, apply now! Only those applicants who meet the above criteria will... 
    Work at office
    Remote work

    Dexis Consulting Group

    Washington DC
    4 days ago
  •  ...Job DescriptionProSidian Seeks a Infrastructure Project Evaluation and Coordination Specialist [DOE0080079] for Program Support on a Exempt W2: No Overtime...  ...of North Carolina. All applicants are encouraged to apply regardless of Veteran Status.Furthermore, we believe in... 
    Full time
    Contract work
    Temporary work
    For contractors
    For subcontractor
    Work at office
    Remote work
    Flexible hours

    Prosidian Consultng

    Richland, WA
    2 days ago
  •  ...Senior Evaluation Specialist This role combines rigorous evaluation with real community impact. The Senior Evaluation Specialist will support...  ...findings into actionable insights that program teams can apply to improve design and delivery Facilitate learning conversations... 
    Local area
    Remote work
    Flexible hours

    Louisiana Public Health Institute

    New Orleans, LA
    4 days ago
  •  ...AuraOne is seeking a Haitian Creole Bilingual Expert for a remote evaluation track. You will review prompts and responses, apply the quality rubric, and provide structured feedback. You’ll label edge cases and contribute to retraining data with clear rationales and severity... 
    Hourly pay
    Remote work
    10 hours per week

    AuraOne

    New York, NY
    4 days ago
  •  ...Evaluation Specialist Consultant CXL is seeking an Evaluation Specialist consultant to serve as the Fund's Experimental Design Lead. This...  ...mid-term evaluation (Years 2–3) and the final evaluation, applying a contribution analysis framework to address attribution challenges... 
    Local area
    Remote work

    Wild Me By Conservation X Labs

    United States
    4 days ago
  •  ...remote Business Document Expert (Chinese Speaker) to review Chinese evaluation prompts and responses against a quality rubric. You will...  ...contractor role requires strong attention to detail and the ability to apply rubrics consistently across multi-page tasks. Responsibilities... 
    For contractors
    Remote work

    AuraOne

    New York, NY
    4 days ago
  • $5,540 - $5,780 per month

     ...Apply now Job no: 557227 Work type: Staff Location: San José Categories...  ...Admissions and Program Evaluations (GAPE) in the College of...  ...on schedule. The Evaluation Specialist is responsible for interpreting...  ...apply artificial intelligence (AI) and other emerging technologies... 
    Permanent employment
    Full time
    Work experience placement
    Internship
    Work at office
    Visa sponsorship

    OPT FOR HEALTHY LIVING

    California, MO
    3 days ago
  • $10k

     ...Program Evaluation Specialist Division/Program Summary: The Office of School Health (OSH) is a joint program of the Department of Education...  ...or Orange County. To determine if the residency requirement applies to you, please discuss with the agency representative at the... 
    Full time
    Work at office
    Work from home
    2 days per week

    New York City | Jobs

    Bronx, NY
    4 days ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam...  .... Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Houston, TX
    24 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Applied Biology Benchmark Specialist - AI Evaluation [Remote]. Be the first to apply!