Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Process improvement / SOPs Evaluator [Remote]

$80 - $120 per hour

AuraOne Human Data

Remote
  • Remote job

Process improvement / SOPs Evaluator is a remote evaluation track for reviewing process improvement / sops evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.

Why this role matters

AI data reviewers help turn process improvement / sops evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.

Responsibilities

  • Evaluate process improvement / sops evaluation model outputs against a versioned rubric and assign severity tags for Process improvement / SOPs Evaluator assignments.
  • Compare paired responses and pick the stronger answer with a written rationale.
  • Label hallucinations, instruction-following failures, and unsafe content with structured tags.
  • Capture ambiguous prompts and route them back to the program team for rubric updates.
  • Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
  • Document recurring failure modes so the modeling team can target them in the next training run.

Qualifications

  • Prior evaluation, annotation, or human-rater experience on process improvement / sops evaluation or adjacent content for Process improvement / SOPs Evaluator work.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the issue and the rubric clause being applied.
  • Strong attention to detail and the ability to flag when a prompt itself is the problem.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Compare two process improvement / sops evaluation model responses to the same prompt and pick the stronger one with rationale.
  • Tag an unsafe response with the correct policy category and severity.
  • Audit a 50-row batch for rubric consistency and report drift to the program lead.
  • Propose a rubric clarification after spotting a recurring failure mode.

Nice to have

  • Background in linguistics, content moderation, or trust & safety review.
  • Experience with inter-rater agreement metrics and calibration cycles.
  • Domain expertise that lets you spot subject-matter errors automated checks miss.

Skills

  • Model output evaluation
  • Rubric-based annotation
  • Severity tagging
  • Inter-rater calibration
  • Process improvement / SOPs evaluation

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

$80–$120 / hr

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 12 days ago
Similar jobs that could be interesting for youBased on the Process improvement / SOPs Evaluator [Remote] in Remote vacancy
  • $80 - $120 per hour

     ...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI... 
    Process improvement
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    22 days ago
  • $80 - $120 per hour

     ...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI... 
    Process improvement
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    16 days ago
  • $60k - $100k

     ...mindset—eager to learn, adapt, and evolve with the company Ability to work independently while remaining open to feedback and process improvements Strong analytical skills and attention to detail Proficiency with appraisal software and market research tools A... 
    Process improvement
    For contractors
    Immediate start
    Remote work

    Banks Valuation

    Twin Falls, ID
    3 days ago
  • $60k - $100k

     ...valuations. Our structured quality control process and technology-driven efficiencies help...  ...begin with a 90-day period to evaluate performance, reliability, and alignment...  ...remaining open to feedback and process improvements Strong analytical skills and attention... 
    Process improvement
    For contractors
    Remote work

    Banks Valuation

    United States
    16 hours ago
  •  ...functional design. Generates fee quotes. Presents final evaluations and property value estimates to home buyers, sellers, investors...  ...with Lead Appraiser to resolve ongoing requests and make process improvement recommendations to eliminate addendums and quality control... 
    Process improvement
    Remote job
    Minimum wage
    Local area

    First American Financial Corporation

    Kansas City, MO
    16 hours ago
  •  ...and/or mental functioning has significantly changed. You will evaluate individuals to help determine appropriate next-level-of-care recommendations...  ...of medical record structure, medical terminology, and disease processes. Strong organizational skills, attention to detail, and... 
    Relief
    Work at office
    Local area
    Work from home

    Astyra Corporation

    Scottsbluff, NE
    6 days ago
  •  ...The Mental Health Evaluator (MHE) is a critical role dedicated to delivering comprehensive, clinically appropriate, culturally competent...  ...health and hospital-based Quality Assurance and Performance Improvement programs Participate in staff meetings regularly. Perform... 

    WMCHealth

    Kingston, OK
    16 hours ago
  •  ...will work within defined guidelines and framework, investigate, evaluate, negotiate and settle complex property insurance claims...  ...thorough, and current claim file documentation throughout the claims process. ~ Applies proficient knowledge of estimating technology platforms... 
    Hourly pay
    Full time
    Local area
    Remote work
    Relocation
    Afternoon shift

    USAA

    Portland, OR
    13 days ago
  •  ...Seeking PhD-level quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content and contribute to the evaluation of advanced AI models in a flexible, remote contract role. Key Responsibilities Assessing the factuality... 
    Full time
    Contract work
    Remote work
    Flexible hours

    Virtual Vocations Inc

    United States
    3 days ago
  • $39.52k - $43.68k

     ...The MID Intake Evaluator will work in a community behavioral health and addiction setting, providing services to individuals who have...  ...team. Actively participate in all licensing and accreditation processes. Serve as a liaison to relevant service systems, state... 
    Hourly pay
    Full time
    Temporary work
    Local area
    Remote work
    Trial period
    Flexible hours

    Mental Health Association - Western MA

    Remote
    2 days ago
  • $166.4k

     ...PRN Bilingual Forensic Evaluator – Competency Restoration Program Correctional Healthcare Partners (CHP) Location: Remote Employment Type: PRN / As Needed Compensation: $80/hour Language Requirement: Bilingual – English & Spanish Position Overview... 
    Hourly pay
    Daily paid
    Relief
    Work at office
    Remote work

    CHP Health

    California
    3 days ago
  • $60k

     ...Position Highlights Position Title: Program Evaluator Location: Remote, Hartford, CT (...  ...implementing, and maintaining a framework and process for monitoring and evaluating projects...  ...results to help advance program improvement by working closely with program staff.... 
    Full time
    For contractors
    Work experience placement
    Local area
    Remote work
    Relocation
    Flexible hours

    CDC Foundation

    Remote
    5 days ago
  •  ...support the Overdose Data to Action initiative, the hybrid Program Evaluator will design, implement, and maintain evaluation frameworks for...  ...projects, ensuring effective program progression and improvement. Key responsibilities Design and evaluate program progression... 
    Work experience placement
    Remote work

    Virtual Vocations Inc

    United States
    3 days ago
  •  ...Mystery Evaluators (Gig / project-based work) - Freelance work - Multiple Opportunities Available in PAN India. Gujarat - Chikhli, Palanpur, Patan, Bhuj, Bharuch Karnataka - Bangalore Odisha - Bhubaneswar Tamil Nadu - Salem, Hosur, Madurai, Vellore, Tiruppur... 
    Extra income
    Freelance

    BARE International

    Remote
    5 days ago
  • $54.28k - $87.05k

     ...Title: 988 Suicide and Crisis Lifeline Evaluator Job Title: Program Specialist V...  ...policy and administrative work related to improving the state response to 988 contacts in the...  ...and implementation of program systems, processes, procedures, and forms to ensure success... 
    Full time
    Contract work
    Temporary work
    Part time
    For contractors
    Work at office
    Local area
    Remote work
    Shift work

    Texas Health & Human Services Commission

    Remote
    2 days ago
  • $14.5 per hour

     ...you to join us! Job Description As a Web Search Evaluator, you will play a key role in improving the quality of search engine results, ensuring users...  ...eligibility verification form To be successful in the process, candidates must sign a Non-Disclosure Agreement to... 
    Part time
    Currently hiring
    Immediate start
    Remote work
    Work from home
    10 hours per week
    Flexible hours

    Jobs for Humanity

    United States
    16 hours ago
  • $14.5 per hour

     ...AI Web Search Evaluator Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant...  ...internet! Are you curious, tech-savvy, and passionate about improving online search experiences? Join our team as a Web Search... 
    Bi-weekly pay
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    Flexible hours

    Welo Data

    United States
    2 days ago
  •  ...alongside iconic names like Louis Vuitton, Dolce & Gabbana, Bentley, Prada, Versace, and more. About the Role As a luxury brand evaluator, you will step into the world of luxury to discreetly assess customer experiences, providing critical feedback that helps brands... 
    Contract work
    Worldwide
    Flexible hours

    CXG

    Florida
    16 hours ago
  •  ...Web Browsing Evaluator Contractor Remote Micro1 is engaging Web Browsing Evaluators to contribute high-quality web interaction...  ...Provide clear written documentation and feedback on the browsing process, highlighting any anomalies or ambiguities encountered.... 
    For contractors
    Remote work

    ESR Healthcare

    New York, NY
    4 days ago
  •  ...accounting and fund control systems to analyze and evaluate the financial posture of the organization or...  ..., and updates Standard Operation Procedures (SOPs), process documentation, and financial system specifications to improve consistency and audit readiness. Facilitates... 
    Process improvement
    Full time
    Remote work

    Defense Logistics Agency

    San Antonio, TX
    1 day ago
  • A global leader in customer experience seeks luxury brand evaluators to assess customer experiences with premium brands. As an evaluator, you will enjoy flexible assignments tailored to your interests. Responsibilities include visiting stores or evaluating online, observing... 
    Flexible hours

    CXG

    Florida
    16 hours ago
  •  ...with users and IT support groups, and helps improve service delivery through consistent...  ...listening, written and verbal communication, and process improvement practices such as ITIL...  ...workstation software, knowledge articles, SOPs, and documented troubleshooting workflows... 
    Process improvement
    Remote work

    NuAxis Innovations

    Amarillo, TX
    3 hours ago
  • $80k - $85k

     ...and update Standard Operating Procedures (SOPs) for network operations and maintenance...  ...and maintain documentation for on-site processes Escalate tickets requiring Service Delivery...  ...issues Identify opportunities for improvement and make constructive suggestions for change... 
    Process improvement
    Remote work
    Work from home
    Flexible hours

    Enhanced Computing Solutions

    Sparks, NV
    16 hours ago
  • $80k - $130k

     ...work.Work You’ll DoAs a Project - Program Analytics & Insights Evaluator II on the project, you will be responsible for:Supporting the design...  ...a reasonable accommodation to participate in the recruiting process, please direct your inquiries to the Global Call Center (GCC)... 
    Local area

    Deloitte

    Atlanta, GA
    2 days ago
  •  ...review key internal controls, and support audit requests and remediation Support development of accounting policies, SOPs, and process improvements Leverage automation and AI-assisted tools (e.g., Microsoft Copilot, Power Automate) to improve efficiency while... 
    Process improvement
    Work at office
    Remote work

    StevenDouglas

    Durham, NC
    3 days ago
  •  ...Specialist is responsible for improving inventory accuracy,...  ...identify gaps, and implement process improvements that enhance tracking...  ...leadership and purchasing teams to evaluate inventory accuracy, identify...  ...of inventory policies, SOPs, and internal control standards... 
    Process improvement
    Remote job
    Afternoon shift

    BrightSpring Health Services

    Louisville, KY
    18 days ago
  • $55 per hour

     ...Charter Trauma Clinic, a division of The Key Program, Inc., is seeking to hire a part-time (15-20 hrs. per week) fee-for-service evaluator. Founded in 1985, the Forensic Services Team has a long-standing reputation as the leading provider of Child Trauma and Parental Capacity... 
    Hourly pay
    Part time
    Remote work
    Flexible hours

    Key Program, Inc.

    Waltham, MA
    23 days ago
  • $41.6k - $46.8k

     ..., present and maintain strategic operating procedures (SOP) and training manuals. Proactively oversee the activities...  ...the learning and development of staff, system/process efficiencies and overall improvement strategies. Actively participate in work flow discussions... 
    Process improvement
    Full time
    Remote work

    TridentCare

    Maryland
    9 days ago
  • CXG is seeking a luxury brand evaluator to discreetly assess customer experiences across premium stores and online interactions. You will observe ambiance, service quality, and overall user experience, then share honest feedback through our surveys. Join a global network... 
    Flexible hours

    CXG

    Windcrest, TX
    1 day ago
  •  ...automobiles. Join CXG, the global leader in customer experience, and work alongside iconic brand names. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess customer experiences, providing critical feedback that helps brands... 
    Contract work
    Worldwide
    Flexible hours

    CXG

    Mc Cordsville, IN
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Process improvement / SOPs Evaluator [Remote]. Be the first to apply!