Applied Biology Benchmark Specialist - AI Evaluation [Remote]
$60 - $75 per hourAuraOne Human Data
- Remote job
Applied Biology Benchmark Specialist - AI Evaluation is a remote review track for evaluating AI outputs across biology reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling team can train on it.
Why this role matters
Biology models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would — checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one.
Responsibilities
- Review AI outputs against current biology methods, conventions, and prior work for Applied Biology Benchmark Specialist - AI Evaluation assignments.
- Reproduce or sanity-check key derivations, calculations, or experimental claims.
- Flag dimensional, methodological, and citation errors with structured severity tags.
- Capture the corrected reasoning or worked example so the modeling team can train on it.
- Adjudicate disputed answers against textbooks, papers, or community standards.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
- Graduate-level training or equivalent applied experience in biology or a closely related field for Applied Biology Benchmark Specialist - AI Evaluation work.
- Hands-on experience publishing, teaching, or advising on the topic at a professional level.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that cites methods, papers, or worked examples.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Reproduce a biology derivation from a model output and flag any algebraic or dimensional errors.
- Grade a model's literature summary against the cited papers and rate the citation quality.
- Adjudicate a disputed answer between two reviewers using textbook methods.
- Audit a 25-row batch for rubric consistency and report drift to the program lead.
Nice to have
- PhD, postdoc, or industry research experience in the topic area.
- Prior work reviewing AI-assisted research tooling and its failure modes.
- Multilingual fluency for non-English papers and corpora.
Skills
- Scientific reasoning
- Method validation
- Citation review
- Quantitative analysis
- Biology
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
$60–$75 / hr
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
- ...French Audio Evaluations Specialist - Freelance AI Trainer Project World Wide - Remote Project Overview... ...Audio Evaluation Specialists for an AI benchmark evaluation project assessing... ...as health insurance and PTO do not apply. Engagement Type: Freelance / Independent...SuggestedHourly payFor contractorsFreelanceRemote work
$20 per hour
...Overview We are sourcing independent Search Engine Evaluation Specialists to provide their expertise for an AI benchmark evaluation project. As AI models increasingly... ...such as health insurance and PTO do not apply. Engagement Type: Freelance / Independent...SuggestedHourly payTemporary workFor contractorsFreelanceRemote work$94 - $119 per hour
...Applied Health & Medicine Benchmark Specialist is a remote clinical-review track for evaluating AI outputs that touch clinical review. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected...SuggestedRemote jobFor contractors10 hours per week- ESR Healthcare is looking for a Robotics Evaluation Specialist to work remotely, applying expertise to train AI systems. This role includes executing physical actions on camera, evaluating robotic performance, and providing structured feedback. The ideal candidate should...SuggestedRemote job
$66 - $84 per hour
...Applied Computer Science Benchmark Specialist is a remote review track for evaluating AI outputs across applied computer science benchmark specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk...SuggestedRemote jobFor contractorsWork experience placement10 hours per week- ...Benchmark Regression Model Evaluation Specialist is a remote evaluation track for reviewing benchmark regression model... .... Why this role matters AI data reviewers help turn benchmark... ...Evaluation Specialist work. Comfort applying multi-page rubrics consistently across...Remote jobHourly payFor contractors10 hours per week
$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... ..., our investors include Benchmark , General Catalyst , Peter... ...philanthropy / community programs Evaluator Type: Contract Compensation... ...AI model outputs . Apply deep subject-matter expertise...Contract workSummer workWork at officeRemote work- ...25 applicants Get AI-powered advice on... ...solid foundation in Biology, particularly at... ...problem types with evaluation goals, especially... ...defining new evaluation benchmarks based on Biology... ...and encouraged to apply. Good research and... ...for “Biology Specialist” roles. Biology Field...Contract workFreelanceRemote work
$60 - $90 per hour
...technical talent with leading AI research labs. Headquartered in... ..., our investors include Benchmark , General Catalyst , Peter... ...cybersecurity topics. Evaluate and annotate model responses for... ...handling of sensitive content. Apply structured guidelines to...Full timeContract workSummer workImmediate startRemote work$50 per hour
...Remote contract for PhDs in Biology, Biotechnology,... ...edge projects with top AI labs while earning up to... ...researchers to build better benchmarks. Responsibilities... ...with rigorous logic. Evaluate AI outputs for accuracy... ...agents; and second, by applying that expertise to help...Remote jobContract workFlexible hours$125 per hour
...Role Overview QGIS Specialists apply geographic information system and spatial analysis expertise to evaluate AI-generated spatial outputs, develop domain-specific prompts, and provide targeted feedback that improves AI understanding of GIS tasks and spatial data workflows...Hourly payContract workPart timeWork experience placementRemote workFlexible hours$125 per hour
...Role Overview ParaView Specialists apply hands-on experience with scientific visualization, fluid dynamics simulation, and large dataset analysis to evaluate AI-generated outputs and guide AI systems to better understand computational science tasks and high-performance...Hourly payFull timeContract workPart timeFor contractorsRemote workFlexible hours- Remote Biology Specialist (Master’s/PhD) - 34880 Remote Biology... ...first 25 applicants Get AI-powered advice on this... ...problem types with evaluation goals, especially in areas... ...new evaluation benchmarks based on Biology curricula... ...eligible and encouraged to apply. Ability to analyze...Remote jobHourly payContract workTemporary workFor contractorsFreelance
$60 - $90 per hour
...careful analysis, and convert discoveries into robust benchmark tasks used to strengthen model evaluation. Typical probes require one to two days of continuous... ...in research, research engineering, security, or AI evaluation. Proven ability to identify vulnerabilities...Hourly payFull timeFreelanceRemote work$1,750 - $2,150 per month
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam... ...Role Responsibilities Review and evaluate AI-generated outputs related to threat analysis...Hourly payFull timeContract workSummer workRemote work$85 per hour
...Role Overview Pre-construction Managers apply hands-on energy project estimation, construction planning, and solar design expertise to evaluate AI-generated outputs and create expert training data that improves AI understanding of project development workflows and cost...Hourly payContract workRemote workFlexible hours$35 - $65 per hour
Pure Mathematics Specialist - Freelance AI Trainer Project World Wide - Remote... ...day, you will construct and evaluate complex proofs, substantiate... ...and mathematical reasoning benchmarks, enhancing the overall quality... ...backbone of tomorrow’s AI? Apply today and help teach the...Hourly payContract workFor contractorsFreelanceRemote work$11 - $30.65 per hour
Spanish Audio Specialist - Freelance AI Trainer Project World Wide - Remote A project... ...dedicated to assessing and benchmarking advanced agentic audio... ...program’s mission is to evaluate and optimize model performance... ...insurance and PTO do not apply. Job title: Spanish Audio...Hourly payContract workFor contractorsFreelanceRemote work- Dorado is seeking a Physics Specialist to contribute deep scientific expertise to AI model evaluation. You will craft and assess challenging physics problems, probe model reasoning at the frontier, and help identify where models fail under rigorous scientific scrutiny....Remote job
- ...Sciences; Nutrient Management Specialist Job no: 539654... ...Categories: Biology/Life Science, Agricultural... ...disability is needed to apply for this position, please... ...as well as integrating AI and/or precision agriculture... ...are required to be evaluated by a professional...Permanent employmentTemporary workWork at officeLocal area
- ...To support program evaluation and advanced analytics, the full-time Program Evaluation Specialist will lead the design and implementation of evaluations, utilizing quantitative... ...research and evidence-based frameworks Apply advanced statistical methods to develop consistent...Full timeRemote work
- ...creativity will be rewarded.About the PositionThe Monitoring and Evaluation (M&E) Specialist will provide technical support to the Office of Monitoring... ...will you? If you are passionate about this opportunity, apply now! Only those applicants who meet the above criteria will...Work at officeRemote work
- ...Job DescriptionProSidian Seeks a Infrastructure Project Evaluation and Coordination Specialist [DOE0080079] for Program Support on a Exempt W2: No Overtime... ...of North Carolina. All applicants are encouraged to apply regardless of Veteran Status.Furthermore, we believe in...Full timeContract workTemporary workFor contractorsFor subcontractorWork at officeRemote workFlexible hours
- ...Senior Evaluation Specialist This role combines rigorous evaluation with real community impact. The Senior Evaluation Specialist will support... ...findings into actionable insights that program teams can apply to improve design and delivery Facilitate learning conversations...Local areaRemote workFlexible hours
- ...AuraOne is seeking a Haitian Creole Bilingual Expert for a remote evaluation track. You will review prompts and responses, apply the quality rubric, and provide structured feedback. You’ll label edge cases and contribute to retraining data with clear rationales and severity...Hourly payRemote work10 hours per week
- ...Evaluation Specialist Consultant CXL is seeking an Evaluation Specialist consultant to serve as the Fund's Experimental Design Lead. This... ...mid-term evaluation (Years 2–3) and the final evaluation, applying a contribution analysis framework to address attribution challenges...Local areaRemote work
- ...remote Business Document Expert (Chinese Speaker) to review Chinese evaluation prompts and responses against a quality rubric. You will... ...contractor role requires strong attention to detail and the ability to apply rubrics consistently across multi-page tasks. Responsibilities...For contractorsRemote work
$5,540 - $5,780 per month
...Apply now Job no: 557227 Work type: Staff Location: San José Categories... ...Admissions and Program Evaluations (GAPE) in the College of... ...on schedule. The Evaluation Specialist is responsible for interpreting... ...apply artificial intelligence (AI) and other emerging technologies...Permanent employmentFull timeWork experience placementInternshipWork at officeVisa sponsorship$10k
...Program Evaluation Specialist Division/Program Summary: The Office of School Health (OSH) is a joint program of the Department of Education... ...or Orange County. To determine if the residency requirement applies to you, please discuss with the agency representative at the...Full timeWork at officeWork from home2 days per week$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam... .... Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–...Contract workSummer workWork at officeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Applied Biology Benchmark Specialist - AI Evaluation [Remote]. Be the first to apply!
- senior safety specialist Remote
- rcm specialist Remote
- health specialist Remote
- outreach specialist Remote
- invoice specialist Remote
- information technology specialist Remote
- rehabilitation specialist Remote
- asset protection specialist Remote
- change management specialist Remote
- housing program specialist Remote




