Process improvement / SOPs Evaluator [Remote]
$80 - $120 per hourAuraOne Human Data
- Remote job
Process improvement / SOPs Evaluator is a remote evaluation track for reviewing process improvement / sops evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.
Why this role matters
AI data reviewers help turn process improvement / sops evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.
Responsibilities
- Evaluate process improvement / sops evaluation model outputs against a versioned rubric and assign severity tags for Process improvement / SOPs Evaluator assignments.
- Compare paired responses and pick the stronger answer with a written rationale.
- Label hallucinations, instruction-following failures, and unsafe content with structured tags.
- Capture ambiguous prompts and route them back to the program team for rubric updates.
- Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
- Document recurring failure modes so the modeling team can target them in the next training run.
Qualifications
- Prior evaluation, annotation, or human-rater experience on process improvement / sops evaluation or adjacent content for Process improvement / SOPs Evaluator work.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that names the issue and the rubric clause being applied.
- Strong attention to detail and the ability to flag when a prompt itself is the problem.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Compare two process improvement / sops evaluation model responses to the same prompt and pick the stronger one with rationale.
- Tag an unsafe response with the correct policy category and severity.
- Audit a 50-row batch for rubric consistency and report drift to the program lead.
- Propose a rubric clarification after spotting a recurring failure mode.
Nice to have
- Background in linguistics, content moderation, or trust & safety review.
- Experience with inter-rater agreement metrics and calibration cycles.
- Domain expertise that lets you spot subject-matter errors automated checks miss.
Skills
- Model output evaluation
- Rubric-based annotation
- Severity tagging
- Inter-rater calibration
- Process improvement / SOPs evaluation
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
$80–$120 / hr
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI...Process improvementContract workSummer workWork at officeRemote work$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI...Process improvementContract workSummer workWork at officeRemote work$60k - $100k
...mindset—eager to learn, adapt, and evolve with the company Ability to work independently while remaining open to feedback and process improvements Strong analytical skills and attention to detail Proficiency with appraisal software and market research tools A...Process improvementFor contractorsImmediate startRemote work$60k - $100k
...valuations. Our structured quality control process and technology-driven efficiencies help... ...begin with a 90-day period to evaluate performance, reliability, and alignment... ...remaining open to feedback and process improvements Strong analytical skills and attention...Process improvementFor contractorsRemote work- ...functional design. Generates fee quotes. Presents final evaluations and property value estimates to home buyers, sellers, investors... ...with Lead Appraiser to resolve ongoing requests and make process improvement recommendations to eliminate addendums and quality control...Process improvementRemote jobMinimum wageLocal area
- ...and/or mental functioning has significantly changed. You will evaluate individuals to help determine appropriate next-level-of-care recommendations... ...of medical record structure, medical terminology, and disease processes. Strong organizational skills, attention to detail, and...ReliefWork at officeLocal areaWork from home
- ...The Mental Health Evaluator (MHE) is a critical role dedicated to delivering comprehensive, clinically appropriate, culturally competent... ...health and hospital-based Quality Assurance and Performance Improvement programs Participate in staff meetings regularly. Perform...
- ...will work within defined guidelines and framework, investigate, evaluate, negotiate and settle complex property insurance claims... ...thorough, and current claim file documentation throughout the claims process. ~ Applies proficient knowledge of estimating technology platforms...Hourly payFull timeLocal areaRemote workRelocationAfternoon shift
- ...Seeking PhD-level quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content and contribute to the evaluation of advanced AI models in a flexible, remote contract role. Key Responsibilities Assessing the factuality...Full timeContract workRemote workFlexible hours
$39.52k - $43.68k
...The MID Intake Evaluator will work in a community behavioral health and addiction setting, providing services to individuals who have... ...team. Actively participate in all licensing and accreditation processes. Serve as a liaison to relevant service systems, state...Hourly payFull timeTemporary workLocal areaRemote workTrial periodFlexible hours$166.4k
...PRN Bilingual Forensic Evaluator – Competency Restoration Program Correctional Healthcare Partners (CHP) Location: Remote Employment Type: PRN / As Needed Compensation: $80/hour Language Requirement: Bilingual – English & Spanish Position Overview...Hourly payDaily paidReliefWork at officeRemote work$60k
...Position Highlights Position Title: Program Evaluator Location: Remote, Hartford, CT (... ...implementing, and maintaining a framework and process for monitoring and evaluating projects... ...results to help advance program improvement by working closely with program staff....Full timeFor contractorsWork experience placementLocal areaRemote workRelocationFlexible hours- ...support the Overdose Data to Action initiative, the hybrid Program Evaluator will design, implement, and maintain evaluation frameworks for... ...projects, ensuring effective program progression and improvement. Key responsibilities Design and evaluate program progression...Work experience placementRemote work
- ...Mystery Evaluators (Gig / project-based work) - Freelance work - Multiple Opportunities Available in PAN India. Gujarat - Chikhli, Palanpur, Patan, Bhuj, Bharuch Karnataka - Bangalore Odisha - Bhubaneswar Tamil Nadu - Salem, Hosur, Madurai, Vellore, Tiruppur...Extra incomeFreelance
$54.28k - $87.05k
...Title: 988 Suicide and Crisis Lifeline Evaluator Job Title: Program Specialist V... ...policy and administrative work related to improving the state response to 988 contacts in the... ...and implementation of program systems, processes, procedures, and forms to ensure success...Full timeContract workTemporary workPart timeFor contractorsWork at officeLocal areaRemote workShift work$14.5 per hour
...you to join us! Job Description As a Web Search Evaluator, you will play a key role in improving the quality of search engine results, ensuring users... ...eligibility verification form To be successful in the process, candidates must sign a Non-Disclosure Agreement to...Part timeCurrently hiringImmediate startRemote workWork from home10 hours per weekFlexible hours$14.5 per hour
...AI Web Search Evaluator Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant... ...internet! Are you curious, tech-savvy, and passionate about improving online search experiences? Join our team as a Web Search...Bi-weekly payHourly payPart timeImmediate startRemote workWork from homeFlexible hours- ...alongside iconic names like Louis Vuitton, Dolce & Gabbana, Bentley, Prada, Versace, and more. About the Role As a luxury brand evaluator, you will step into the world of luxury to discreetly assess customer experiences, providing critical feedback that helps brands...Contract workWorldwideFlexible hours
- ...Web Browsing Evaluator Contractor Remote Micro1 is engaging Web Browsing Evaluators to contribute high-quality web interaction... ...Provide clear written documentation and feedback on the browsing process, highlighting any anomalies or ambiguities encountered....For contractorsRemote work
- ...accounting and fund control systems to analyze and evaluate the financial posture of the organization or... ..., and updates Standard Operation Procedures (SOPs), process documentation, and financial system specifications to improve consistency and audit readiness. Facilitates...Process improvementFull timeRemote work
- A global leader in customer experience seeks luxury brand evaluators to assess customer experiences with premium brands. As an evaluator, you will enjoy flexible assignments tailored to your interests. Responsibilities include visiting stores or evaluating online, observing...Flexible hours
- ...with users and IT support groups, and helps improve service delivery through consistent... ...listening, written and verbal communication, and process improvement practices such as ITIL... ...workstation software, knowledge articles, SOPs, and documented troubleshooting workflows...Process improvementRemote work
$80k - $85k
...and update Standard Operating Procedures (SOPs) for network operations and maintenance... ...and maintain documentation for on-site processes Escalate tickets requiring Service Delivery... ...issues Identify opportunities for improvement and make constructive suggestions for change...Process improvementRemote workWork from homeFlexible hours$80k - $130k
...work.Work You’ll DoAs a Project - Program Analytics & Insights Evaluator II on the project, you will be responsible for:Supporting the design... ...a reasonable accommodation to participate in the recruiting process, please direct your inquiries to the Global Call Center (GCC)...Local area- ...review key internal controls, and support audit requests and remediation Support development of accounting policies, SOPs, and process improvements Leverage automation and AI-assisted tools (e.g., Microsoft Copilot, Power Automate) to improve efficiency while...Process improvementWork at officeRemote work
- ...Specialist is responsible for improving inventory accuracy,... ...identify gaps, and implement process improvements that enhance tracking... ...leadership and purchasing teams to evaluate inventory accuracy, identify... ...of inventory policies, SOPs, and internal control standards...Process improvementRemote jobAfternoon shift
$55 per hour
...Charter Trauma Clinic, a division of The Key Program, Inc., is seeking to hire a part-time (15-20 hrs. per week) fee-for-service evaluator. Founded in 1985, the Forensic Services Team has a long-standing reputation as the leading provider of Child Trauma and Parental Capacity...Hourly payPart timeRemote workFlexible hours$41.6k - $46.8k
..., present and maintain strategic operating procedures (SOP) and training manuals. Proactively oversee the activities... ...the learning and development of staff, system/process efficiencies and overall improvement strategies. Actively participate in work flow discussions...Process improvementFull timeRemote work- CXG is seeking a luxury brand evaluator to discreetly assess customer experiences across premium stores and online interactions. You will observe ambiance, service quality, and overall user experience, then share honest feedback through our surveys. Join a global network...Flexible hours
- ...automobiles. Join CXG, the global leader in customer experience, and work alongside iconic brand names. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess customer experiences, providing critical feedback that helps brands...Contract workWorldwideFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Process improvement / SOPs Evaluator [Remote]. Be the first to apply!







