Science Curriculum AI Evaluator [Remote]
AuraOne Human Data
Remote
- Remote job
Science Curriculum AI Evaluator is a remote review track for evaluating AI outputs across science curriculum ai specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it.
Why this role matters
Science Curriculum AI specialist operations AI has to fit into an actual day at work. AuraOne uses experienced operators to grade outputs the way a senior peer would — checking workflow, policy, and the unwritten rules that decide whether a task actually gets done.
Responsibilities
- Review AI outputs against current science curriculum ai specialist operations workflows, playbooks, and firm policy for Science Curriculum AI Evaluator assignments.
- Grade tone, escalation logic, and stakeholder fit on a structured rubric.
- Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
- Capture the right next step so the modeling team can train on it.
- Adjudicate disputed treatments against published playbooks or firm guidance.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
- Direct working experience in science curriculum ai specialist operations on real teams for Science Curriculum AI Evaluator work.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that names the policy or workflow being applied.
- Strong attention to detail and the ability to flag when a prompt itself is the problem.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Grade a model's response to a real science curriculum ai specialist operations ticket and rate workflow, tone, and escalation.
- Flag a missed escalation with the right severity tag and corrected next step.
- Adjudicate a disputed playbook call between two reviewers using firm guidance.
- Audit a 25-row batch for rubric consistency and report drift to the program lead.
Nice to have
- Prior experience training, calibrating, or QA-ing operations teams.
- Familiarity with AI-assisted workflow tooling and its failure modes.
- Bilingual experience for cross-region operations.
Skills
- Operational review
- Policy adherence
- Workflow judgment
- Stakeholder communication
- Science Curriculum AI specialist operations
- Learning design
- Assessment review
- Pedagogy
- Science
- Curriculum
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the Science Curriculum AI Evaluator [Remote] in Remote vacancy
$40 - $100 per hour
About OpenTrain OpenTrain AI is the hiring and contracting organization for this opportunity... .... In this role, your astronomy and space science expertise will help improve how advanced... ...work About AI Training and Scientific Evaluation AI training is the human side of building...SuggestedHourly payContract workPart timeFor contractorsRemote work- Mercor is seeking expert Evaluators in user and customer research to review AI-generated work products for accuracy, rigor, and domain quality. This remote, hourly role requires applying deep subject-matter expertise to grade outputs and provide clear, structured feedback...SuggestedRemote jobHourly pay
- YO AI Labs seeks Medical Evaluation Specialists to craft and validate challenging medical questions for evaluating AI systems. This remote contractor role welcomes medical students, residents, physicians, and biomedical professionals. You will build complex Q&A pairs,...SuggestedFor contractorsRemote work
$180 per hour
...platform for finding and building careers in AI training and data labeling. OpenTrain AI... ...improve legal AI systems through expert evaluation and structured feedback. AI training is... ...law clinics Experience developing legal curriculum or assessment rubrics Published...SuggestedHourly payContract workPart timeFor contractorsRemote workFlexible hours- ...Seeking a full-time Remote AI Research Evaluator with a PhD in Quantitative Finance to assess and enhance AI models' capabilities in financial reasoning and quantitative analysis through flexible, contract-based work. Key responsibilities Assessing the factuality and...SuggestedFull timeContract workRemote workFlexible hours
Virtual Vocations Inc
United States3 days ago $20 per hour
A tech company specializing in AI is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance the model’s understanding of aesthetics. An ideal candidate will have a strong background in UI/UX design and...Remote workFlexible hoursDataAnnotation
Columbia, SC2 days ago- ...Clinical Pharmacist AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch pharma. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so...Remote jobHourly payFor contractors10 hours per week
- ...BAM Ventures is seeking Swedish-speaking remote annotators to evaluate AI-generated content, ensuring that it's coherent and aligns with real-world expectations. Your role will involve reviewing outputs, identifying deviations, and providing structured feedback to enhance...Remote work
BAM VENTURES LLC
New York, NY1 day ago $14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...Hourly payPart timeRemote workFlexible hoursWelo Data
United States4 days ago- ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional...Work at officeRemote work
Obsidian
New York, NY1 day ago $14.5 per hour
...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data...Hourly payPart timeImmediate startRemote workWork from home10 hours per weekFlexible hoursWelo Data
New York, NY2 days ago- Obsidian is seeking expert Evaluators in Humanities / arts / culture to review AI-generated work products for accuracy, rigor, and domain quality. You will apply subject-matter expertise to grade outputs and provide structured feedback. This is a remote, hourly engagement...Remote jobHourly payWork at office
- A virtual AI evaluation firm is seeking individuals to review and evaluate AI-generated responses in therapeutic conversations. The ideal candidate will possess strong written communication and analytical skills, as well as a keen attention to detail for assessing tone...Remote jobImmediate start
- Mercor seeks expert Evaluators in Real estate / hospitality / events to review AI-generated work products for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs. This is a remote, hourly engagement. You will evaluate artifacts...Remote jobHourly pay
- Dorado is seeking an AI Language Quality Evaluator fluent in Greek and English for an ongoing, task-based project. This remote freelance role involves reviewing translated and AI-flagged content to judge accuracy, classify issues, and suggest corrected translations. You...Remote jobFor contractorsFreelanceFlexible hours
$20 - $26 per hour
Prolific is seeking fluent Kannada speakers to act as evaluators. You will assess how naturally and authentically AI captures Kannada speech, by listening to audio clips and comparing text and voice. This fast-paced project pays $20-26 per hour and may require about one...Remote jobHourly payWork from homeFlexible hours- Handshake is seeking an AI Image Evaluator to assess prompts and generated images for quality, accuracy, and policy compliance. You will weigh visual details, compare outputs, and explain your reasoning to help train evaluation models. Remote US role with flexible scheduling...Remote jobFlexible hours
$45 - $55 per hour
This is a non-engineering content-policy evaluation role. Applicants must demonstrate relevant depth in violent fiction or media, military... ...1,600 educational institutions. In 2025, we started Handshake AI and built the fastest-growing AI data business in history. We work...Remote jobMonday to FridayShift work- Mercor is seeking experts in Spreadsheet QA and workbook maintenance to review AI-generated documents, spreadsheets, and slide decks for accuracy and quality. This is a remote, hourly engagement. Ideal candidates have 5+ years in Spreadsheet QA, fluent English, and strong...Remote jobHourly payWork at office
- Alignerr is seeking a Population Health Informaticist for AI training. This remote, hourly contract role requires 10-40 hours per week... ...to improve AI understanding of population health data. You will evaluate AI-generated analyses, identify errors, review data pipelines,...Remote jobHourly payContract work10 hours per weekFlexible hours
- Mercor is seeking expert Evaluators in Clinical/biomedical/pharma to review AI-generated documents, spreadsheets, and slide decks for accuracy and domain quality. Remote, hourly engagement, requiring 5+ years of relevant experience and native/professional English fluency...Remote jobHourly payWork at office
- YO AI Labs is seeking Italian bilingual experts to contribute to language and AI training projects by evaluating Italian audio content for nativeness, fluency, and overall linguistic quality. You will assess pronunciation, intonation, and authenticity, then document clear...Remote job
- Dorado is seeking expert Evaluators in Compliance / regulatory response with financial-services AI to review AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. This is a remote, hourly engagement. You will apply...Remote jobHourly pay
- YO AI Labs is seeking an experienced Adobe Marketing Technology Expert for a remote contractor role. The candidate will test marketing workflows and evaluate AI-generated outcomes across Adobe Workfront, AEM, CJA, Analytics, and Experience Cloud. You will identify workflow...Remote jobFor contractors
$20 - $26 per hour
Prolific seeks fluent Kannada speakers to act as evaluators for AI language data. You will assess text and voice segments, rate naturalness, and help identify cultural nuances. A PayPal account is required to receive payments for tasks priced at $20-$26 per hour. Responsibilities...Remote jobHourly payWork from homeFlexible hours$20 - $26 per hour
Prolific is looking for an AI Trainer who is a fluent Lithuanian speaker to evaluate audio models used in AI development. The role involves reviewing audio snippets, providing feedback on voice quality, and ensuring cultural relevance in pronunciation. Candidates must possess...Remote jobHourly payWork from homeFlexible hours- micro1 is seeking an AI Image & Video Evaluation Specialist (remote, contractor) to generate and compare AI-generated visuals across platforms. You will assess realism, composition, lighting, color, anatomy, and text rendering, delivering structured analyses. No formal...Remote jobFor contractors
- Dorado is seeking expert Evaluators in market research / competitive intelligence to review AI-generated work products for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs. This is a remote, hourly engagement. Requirements...Remote jobHourly payWork at office
- Obsidian is hiring expert Evaluators in Investment analysis / valuation / credit to review AI-generated work products for accuracy and quality. This remote, hourly position requires deep subject-matter expertise and professional fluency in English to provide structured...Hourly payWork at officeRemote work
- Turing is seeking detail-oriented AI Analysts based in the United States for a Google Wallet evaluation project. This role allows you to engage with advanced AI tools while contributing to the future of AI. You will evaluate model responses, review output quality, and provide...Remote jobFull timeContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Science Curriculum AI Evaluator [Remote]. Be the first to apply!
