Science Curriculum AI Evaluator [Remote]
AuraOne Human Data
Remote
- Remote job
Science Curriculum AI Evaluator is a remote review track for evaluating AI outputs across science curriculum ai specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it.
Why this role matters
Science Curriculum AI specialist operations AI has to fit into an actual day at work. AuraOne uses experienced operators to grade outputs the way a senior peer would — checking workflow, policy, and the unwritten rules that decide whether a task actually gets done.
Responsibilities
- Review AI outputs against current science curriculum ai specialist operations workflows, playbooks, and firm policy for Science Curriculum AI Evaluator assignments.
- Grade tone, escalation logic, and stakeholder fit on a structured rubric.
- Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
- Capture the right next step so the modeling team can train on it.
- Adjudicate disputed treatments against published playbooks or firm guidance.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
- Direct working experience in science curriculum ai specialist operations on real teams for Science Curriculum AI Evaluator work.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that names the policy or workflow being applied.
- Strong attention to detail and the ability to flag when a prompt itself is the problem.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Grade a model's response to a real science curriculum ai specialist operations ticket and rate workflow, tone, and escalation.
- Flag a missed escalation with the right severity tag and corrected next step.
- Adjudicate a disputed playbook call between two reviewers using firm guidance.
- Audit a 25-row batch for rubric consistency and report drift to the program lead.
Nice to have
- Prior experience training, calibrating, or QA-ing operations teams.
- Familiarity with AI-assisted workflow tooling and its failure modes.
- Bilingual experience for cross-region operations.
Skills
- Operational review
- Policy adherence
- Workflow judgment
- Stakeholder communication
- Science Curriculum AI specialist operations
- Learning design
- Assessment review
- Pedagogy
- Science
- Curriculum
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Science Curriculum AI Evaluator [Remote] in Remote vacancy
$40 - $100 per hour
About OpenTrain OpenTrain AI is the hiring and contracting organization for this opportunity... .... In this role, your astronomy and space science expertise will help improve how advanced... ...work About AI Training and Scientific Evaluation AI training is the human side of building...SuggestedHourly payContract workPart timeFor contractorsRemote work$45 - $65 per hour
Appsierra Group is seeking an experienced pharmacy technician to evaluate and improve AI medication workflows in healthcare settings. You will create realistic prescription-processing and adjudication scenarios and evaluate AI-generated responses for accuracy and safety...SuggestedRemote jobHourly payContract work10 hours per weekFlexible hours- AI Trainer Jobs is seeking an Equity Research AI Evaluator to remotely review AI outputs in finance and risk workflows. You will grade calculations, narrative reasoning, and policy adherence, flag issues, and document corrected workpapers for training. Prerequisites include...SuggestedRemote jobFor contractors
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedContract workSummer workWork at officeRemote workMercor
Houston, TX5 days ago- ...Weekday 1 is seeking expert Evaluators to review AI-generated real estate, hospitality and events outputs for accuracy, rigor and domain quality. You will apply deep expertise to grade documents, spreadsheets and slide decks. Requirements include 5+ years in Real estate...SuggestedHourly payWeekly payContract workWork at officeRemote workWeekday work
Weekday 1
United States1 day ago - ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...Contract workTemporary workImmediate startRemote work
MERIT Beauty
New York, NY3 days ago - ...Seeking a full-time Remote AI Research Evaluator with a PhD in Quantitative Finance to assess and enhance AI models' capabilities in financial reasoning and quantitative analysis through flexible, contract-based work. Key responsibilities Assessing the factuality and...Full timeContract workRemote workFlexible hours
Virtual Vocations Inc
United States3 days ago $14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...Hourly payPart timeRemote workFlexible hoursWelo Data
United States4 days ago- ...About the role Swahili Evaluation AI Evaluator is a remote evaluation track for reviewing swahili generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback...Hourly payFor contractorsRemote work10 hours per week
AI Trainer Jobs
New York, NY4 days ago - ...Obsidian is hiring expert Evaluators in Real estate, hospitality, and events to review AI-generated work for accuracy, rigor, and domain quality. This remote position requires deep expertise and involves grading outputs like documents and presentations. Applicants must...Work at officeRemote work
Obsidian
San Francisco, CA5 days ago $14.5 per hour
...AI Web Search Evaluator Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years of experience in...Bi-weekly payHourly payPart timeImmediate startRemote workWork from homeFlexible hoursWelo Data
United States2 days ago- ...Alignerr is seeking Creative Writing Evaluators to assess AI-generated stories, essays, poetry, and other writings to shape how AI learns compelling prose. This fully remote, flexible contract roles welcomes avid readers and writers with no publishing credits required...Contract workRemote workFlexible hours
Alignerr Corp.
United States1 day ago $20 per hour
A tech company specializing in AI is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance the model’s understanding of aesthetics. An ideal candidate will have a strong background in UI/UX design and...Remote workFlexible hoursDataAnnotation
United States4 days ago$11.5 per hour
...position as an Online Task Contributor. In this role, you will evaluate and provide feedback on content to enhance search engine results... ...11.50 hourly, based on task completion, with a supportive community of contributors involved in AI advancements. #J-18808-Ljbffr...Hourly payPart timeRemote workUniversity of Delaware
United States4 days ago- ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional...Work at officeRemote work
Obsidian
New York, NY1 day ago $14.5 per hour
...ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years... ...we'd like you to join us! Job Description As a Web Search Evaluator, you will play a key role in improving the quality of search...Part timeCurrently hiringImmediate startRemote workWork from home10 hours per weekFlexible hoursJobs for Humanity
United States5 days ago- ...Clinical Pharmacist AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch pharma. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so...Remote jobHourly payFor contractors10 hours per week
- Alignerr is seeking a Population Health Informaticist for an AI training project. You will evaluate AI outputs on health data, assess population metrics and disparities, and provide structured feedback to improve AI reasoning in health contexts. The role is a fully remote...Remote jobHourly payContract work10 hours per weekFlexible hours
$30 per hour
...Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous agent systems... ...stakeholders. Requirements Strong experience in LLM evaluation, AI output analysis, QA/testing, UX research, or similar analytical...Remote jobHourly payContract work- ...About the role We are hiring expert Evaluators in Data analysis / quantitative readouts to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise...Hourly payWork at officeRemote work
Mercor Inc
New York, NY5 days ago $18 per hour
We are looking for AI Linguistic Evaluators to assess how effectively an AI application performs in Telugu for a short collaboration. Job Type: Freelance Location: Remote from the United States Work Schedule: Flexible Start Date: Immediately Duration: Approximately 10-...FreelanceImmediate startRemote workFlexible hours- Feedinkoo is seeking a Graphic Designer to help train and improve AI models focused on UI/UX design, visuals, and user experiences. You will critique AI outputs, provide feedback, and guide model improvements to better reflect aesthetics and usability for designers. The...Remote work
- Alignerr is seeking Wildlife and Habitat Conservation Scientists to evaluate AI-trained biodiversity protection content. This remote, hourly contract role offers flexible hours (10-40 per week) and a chance to shape how AI understands ecological challenges on a global scale...Remote jobHourly payContract workFlexible hours
$18 per hour
Rws is seeking AI Linguistic Evaluators to assess Malayalam content quality for a short remote collaboration. This freelance role requires native Malayalam and strong English, with attention to linguistic nuance and cultural relevance. Tasks include interacting with an...Remote jobFreelanceImmediate startFlexible hours- A leading AI research accelerator is hiring a position focused on contributing to projects that evaluate and enhance AI systems. You will design community service scenarios, write structured explanations, and evaluate AI accuracy. The ideal candidate will have 4+ years...Remote jobFull timeFor contractors
- Rex.zone is seeking a Senior AI data annotator to perform data labeling and evaluation for NLP tasks, RLHF assessments, and prompt QA to improve training data quality and model performance. This is a US-based remote, full-time role aligned with Miami talent demand. You...Remote jobFull time
- Archangel Health AI is seeking Clinical AI Evaluators to review AI-generated clinical outputs, benchmark diagnostic reasoning, and refine responses to real-world medical queries. You will perform clinical accuracy auditing, RLHF ranking, error and harm identification,...Remote workFlexible hoursShift work
- ...leader in enterprise‑grade data analytics and AI solutions, committed to empowering... ...financial services, CPG, legal, pharma, life sciences, retail and logistics, helping them build... ...EQT. Website: Linkedin Job Title: Evaluator - Political Science Location: Remote (USA...Contract workRemote workWorldwide
- Prolific is seeking fluent Norwegian speakers to act as evaluators for AI training, performing side-by-side assessments of text and voice snippets to judge naturalness and authenticity. You will listen to audio clips and rate how naturally the AI speaks, providing detailed...Remote jobWork from homeFlexible hours
$18 per hour
AI Linguistic Evaluator - Telugu Dallas, Texas RWS - TrainAI / Temporary/Contract / Remote Freelance Remote from the United States Flexible Immediately Approximately 10-15 total hours (around 5 hours per day) 18 USD/hour Access to at least one personal device...Remote jobTemporary workFreelanceImmediate startFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Science Curriculum AI Evaluator [Remote]. Be the first to apply!
