Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Special Education AI Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

Special Education AI Evaluator is a remote review track for evaluating AI outputs across education review workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it.

Why this role matters

Education review AI has to fit into an actual day at work. AuraOne uses experienced operators to grade outputs the way a senior peer would — checking workflow, policy, and the unwritten rules that decide whether a task actually gets done.

Responsibilities

  • Review AI outputs against current education review workflows, playbooks, and firm policy for Special Education AI Evaluator assignments.
  • Grade tone, escalation logic, and stakeholder fit on a structured rubric.
  • Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
  • Capture the right next step so the modeling team can train on it.
  • Adjudicate disputed treatments against published playbooks or firm guidance.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Direct working experience in education review on real teams for Special Education AI Evaluator work.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the policy or workflow being applied.
  • Strong attention to detail and the ability to flag when a prompt itself is the problem.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Grade a model's response to a real education review ticket and rate workflow, tone, and escalation.
  • Flag a missed escalation with the right severity tag and corrected next step.
  • Adjudicate a disputed playbook call between two reviewers using firm guidance.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

  • Prior experience training, calibrating, or QA-ing operations teams.
  • Familiarity with AI-assisted workflow tooling and its failure modes.
  • Bilingual experience for cross-region operations.

Skills

  • Operational review
  • Policy adherence
  • Workflow judgment
  • Stakeholder communication
  • Education review
  • Learning design
  • Assessment review
  • Pedagogy
  • Special
  • Education

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 8 days ago
Similar jobs that could be interesting for youBased on the Special Education AI Evaluator [Remote] in Remote vacancy
  • $40 per hour

    A leading data annotation service is seeking a Biology Expert to train AI models. The role involves measuring AI progress, evaluating chatbot outputs, and ensuring quality improvement. Ideal candidates will have a strong background in biology or biochemistry. This independent... 
    Suggested
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    DataAnnotation

    Iowa, LA
    3 days ago
  • $20 per hour

    A technology company is seeking a Responsive Web Designer to review and improve AI-generated designs. This role offers flexibility in choosing projects and working hours. Candidates should possess a strong design background and fluency in English. Compensation starts at... 
    Suggested
    Contract work
    Remote work

    DataAnnotation

    Denver, CO
    3 days ago
  • $20 per hour

    A leading technology company is seeking a Digital Designer to assess and improve AI-generated designs while working remotely. The role involves reviewing UI/UX outputs, providing critical feedback, and training AI models to enhance aesthetics and usability. Candidates... 
    Suggested
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Florida, NY
    3 days ago
  •  ...Blueprint Technologies is looking for a Labeler/Annotator to evaluate AI-generated responses in French. The ideal candidate will have native or professional fluency in French and strong English comprehension. Responsibilities include performing SBS comparisons, evaluating... 
    Suggested
    Local area
    Remote work

    BluePrint Technologies

    New York, NY
    1 day ago
  •  ...BAM Ventures is seeking Swedish-speaking remote annotators to evaluate AI-generated content, ensuring that it's coherent and aligns with real-world expectations. Your role will involve reviewing outputs, identifying deviations, and providing structured feedback to enhance... 
    Suggested
    Remote work

    BAM VENTURES LLC

    New York, NY
    2 days ago
  • $20 per hour

    A leading AI training company is looking for an Experience Designer to improve AI model outputs by evaluating design work, including interfaces and visuals. This role offers flexible scheduling and the ability to choose projects, with compensation starting at $20+ USD/hr... 
    Contract work
    Remote work
    Flexible hours

    DataAnnotation

    Lincoln, NE
    3 days ago
  • A leading tech company in Alabama is seeking a Marketing Designer to train and improve AI models by evaluating AI-generated designs. The role offers flexibility and competitive pay based on project levels. Ideal candidates will possess strong UI/UX design skills and a good... 
    Remote work

    DataAnnotation

    El Paso, TX
    5 days ago
  • $20 per hour

    A leading AI technology firm in the United States is seeking a Digital Web Designer to evaluate AI-generated designs and enhance the model's understanding of aesthetics. This role offers flexibility with project selection and involves both general AI training and design... 
    Remote work

    DataAnnotation

    Montgomery, AL
    3 days ago
  • $20 per hour

    A tech company specializing in AI is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance the model’s understanding of aesthetics. An ideal candidate will have a strong background in UI/UX design and... 
    Remote work
    Flexible hours

    DataAnnotation

    Columbia, SC
    3 days ago
  • $20 per hour

    A leading data annotation firm is seeking a Web Designer to evaluate AI-generated designs and enhance their understanding of design principles. This remote position offers flexibility in project selection and schedule. Ideal candidates will have a strong background in UI... 
    Remote work

    DataAnnotation

    Wyoming, OH
    5 days ago
  •  ...A leading AI company is seeking detail-oriented linguists with native Turkish fluency for a remote freelance opportunity. This role will focus on AI-related projects that involve prompt evaluation and multimedia content understanding. Ideal candidates will have a strong... 
    Freelance
    Remote work

    Lilt

    New York, NY
    1 day ago
  • $14.5 per hour

     ...ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years...  ...online search experiences? Join our team as a Web Search Evaluator and help shape the future of search engines from the comfort of... 
    Bi-weekly pay
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    Flexible hours

    Jobs for Humanity

    Jacksonville, FL
    1 day ago
  • $40 per hour

    A cybersecurity company is seeking experienced cybersecurity professionals to evaluate AI-generated security content and enhance AI models' effectiveness. This REMOTE role offers flexibility to choose projects that suit your schedule, with hourly pay starting at $40. Candidates... 
    Hourly pay
    Remote work

    DataAnnotation

    Wausau, WI
    3 days ago
  • $14.5 per hour

    A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical... 
    Hourly pay
    Part time
    Remote work
    Flexible hours

    Welo Data

    New York, NY
    3 days ago
  • $40 per hour

    A leading cybersecurity firm is seeking experienced professionals to evaluate AI-generated security content and solve cybersecurity problems. This role, which can be part-time or full-time, offers flexible hours and competitive pay starting from $40+ per hour. Ideal candidates... 
    Hourly pay
    Full time
    Part time
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    4 days ago
  • $40 per hour

     ...We are looking for experienced cybersecurity professionals to join our team to help train AI models. In this role, you will evaluate AI-generated security content, solve technical cybersecurity problems, and provide feedback to improve how AI systems reason about real... 
    Hourly pay
    Full time
    Part time
    Remote work

    DataAnnotation

    Phoenix, AZ
    3 days ago
  • $40 per hour

    A leading cybersecurity firm is seeking experienced professionals to evaluate AI-generated security content and improve AI systems' reasoning about real-world threats. This is a flexible, remote role available to candidates from the US and other countries, offering competitive... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Topeka, KS
    3 days ago
  •  ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional... 
    Work at office
    Remote work

    Obsidian

    New York, NY
    2 days ago
  • $40 per hour

    A cybersecurity training company is seeking experienced professionals to evaluate AI-generated security content and solve technical problems. This is a remote role offering flexibility in project selection and scheduling. Ideal candidates will have over 2 years of cybersecurity... 
    Hourly pay
    Remote work

    DataAnnotation

    Lincoln, NE
    3 days ago
  • $40 per hour

    A cybersecurity technology company is seeking experienced professionals to evaluate AI-generated security content and solve technical cybersecurity problems. This is a remote position open to candidates in the US and several other English-speaking countries, offering flexibility... 
    Hourly pay
    Remote work

    DataAnnotation

    Brooklyn, NY
    4 days ago
  • $40 per hour

    A technology company is seeking experienced cybersecurity professionals to help train AI models by evaluating AI-generated security content and solving technical cybersecurity problems. This role offers full-time or part-time remote work, allowing you to select projects... 
    Hourly pay
    Full time
    Part time
    Remote work

    DataAnnotation

    Wyoming, OH
    3 days ago
  •  ...Turing is seeking graduate students or professionals for a remote role in evaluating AI-generated research reports. Responsibilities include reading, annotating, and scoring reports on a 1-5 scale, alongside providing written justifications. Candidates must possess strong... 
    Remote work

    Turing

    Austin, TX
    2 days ago
  • $40 per hour

    A cybersecurity company is seeking experienced professionals to evaluate AI-generated security content. The role involves solving technical cybersecurity problems, writing clear technical explanations, and providing vital feedback to improve AI models. Candidates should... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Denver, CO
    3 days ago
  • $40 per hour

    A technology company is seeking experienced cybersecurity professionals to join their remote team. The role involves evaluating AI-generated security content, solving technical cybersecurity problems, and providing feedback to enhance AI systems. Candidates should have... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Little Rock, AR
    3 days ago
  • $40 per hour

    A cybersecurity firm is seeking experienced professionals to evaluate AI-generated security content and solve technical cybersecurity problems. You'll train AI models by assessing their outputs and providing feedback to improve real-world threat handling. The ideal candidate... 
    Hourly pay
    Full time
    Part time
    Remote work

    DataAnnotation

    Saint Paul, MN
    3 days ago
  • $40 per hour

    A cybersecurity solutions provider is seeking experienced cybersecurity professionals for a remote role focusing on evaluating AI-generated content and solving technical cybersecurity problems. Candidates will have the flexibility to choose projects and work on their own... 
    Hourly pay
    Remote work

    DataAnnotation

    Columbia, SC
    3 days ago
  • A cybersecurity technology firm is seeking experienced professionals to evaluate AI-generated security content and solve technical challenges related to cybersecurity. Candidates should have at least 2 years of hands-on experience in areas like penetration testing or incident... 
    Remote work

    DataAnnotation

    New York, NY
    3 days ago
  • $80 - $120 per hour

     ...Mercor is seeking a Software / AI / IT / data Evaluator to join their team remotely. In this role, you will evaluate AI-generated artifacts based on quality standards, providing structured feedback and ensuring accuracy. The ideal candidate will have over 5 years of... 
    Hourly pay
    Contract work
    Work at office
    Remote work

    Mercor Inc

    San Francisco, CA
    4 days ago
  • $20 per hour

    A tech company is seeking a Receptionist to assist in training AI models. This role involves evaluating the logic of AI chatbots and ensuring quality in their outputs. Applicants should be fluent in English, detail-oriented, and possess strong writing skills. This position... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    4 days ago
  • $40 per hour

    A tech company is seeking experienced cybersecurity professionals to evaluate AI-generated security content and solve cybersecurity problems. In this remote position, candidates will work on their own schedule, tackling projects that strengthen AI models. Required qualifications... 
    Hourly pay
    Remote work

    DataAnnotation

    Wausau, WI
    8 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Special Education AI Evaluator [Remote]. Be the first to apply!