Pricing / ROI / revenue economics Evaluator [Remote]
$80 - $120 per hourAuraOne Human Data
Remote
- Remote job
Pricing / ROI / revenue economics Evaluator is a remote evaluation track for reviewing pricing / roi / revenue economics evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.
Why this role matters
AI data reviewers help turn pricing / roi / revenue economics evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.
Responsibilities
- Evaluate pricing / roi / revenue economics evaluation model outputs against a versioned rubric and assign severity tags for Pricing / ROI / revenue economics Evaluator assignments.
- Compare paired responses and pick the stronger answer with a written rationale.
- Label hallucinations, instruction-following failures, and unsafe content with structured tags.
- Capture ambiguous prompts and route them back to the program team for rubric updates.
- Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
- Document recurring failure modes so the modeling team can target them in the next training run.
Qualifications
- Prior evaluation, annotation, or human-rater experience on pricing / roi / revenue economics evaluation or adjacent content for Pricing / ROI / revenue economics Evaluator work.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that names the issue and the rubric clause being applied.
- Strong attention to detail and the ability to flag when a prompt itself is the problem.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Compare two pricing / roi / revenue economics evaluation model responses to the same prompt and pick the stronger one with rationale.
- Tag an unsafe response with the correct policy category and severity.
- Audit a 50-row batch for rubric consistency and report drift to the program lead.
- Propose a rubric clarification after spotting a recurring failure mode.
Nice to have
- Background in linguistics, content moderation, or trust & safety review.
- Experience with inter-rater agreement metrics and calibration cycles.
- Domain expertise that lets you spot subject-matter errors automated checks miss.
Skills
- Model output evaluation
- Rubric-based annotation
- Severity tagging
- Inter-rater calibration
- Pricing / ROI / revenue economics evaluation
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
$80–$120 / hr
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Pricing / ROI / revenue economics Evaluator [Remote] in Remote vacancy
$425 per month
...embraces these values, we welcome you to explore our contractor opportunities! Requirements: This position pays up to 50% of revenue , 1-Day Evaluation $350 for remote and $425 for in person, 2-Day Evaluation $742.00 for in person. POSITION SUMMARY The Vocational...SuggestedFull timeFor contractorsWork experience placementWork at officeLocal areaRemote workEmployU, Inc
Lake City, FL17 days ago- ...Seeking a full-time Remote AI Research Evaluator with a PhD in Quantitative Finance to assess and enhance AI models' capabilities in financial... ...quantitative methods such as stochastic modeling, derivatives pricing, and econometrics Strong analytical and critical-thinking...SuggestedFull timeContract workRemote workFlexible hours
Virtual Vocations Inc
United States3 days ago - ...Litigation-focused valuations, SPAC and De-SPAC valuations, or Purchase price allocations Experience with conventional valuation purposes,... ...you bring Uncapped, formula-driven bonus tied to the net revenue you generate Bonus eligibility begins once production covers...SuggestedPermanent employmentFull timeRemote work
Advysor
Remotea month ago - ...Certified Evaluator The Certified Evaluator delivers a convenient, professional, five-star selling experience for Cheddar guestsfrom... ...product values using current market information, comparable sold prices, condition, demand, and expected resale potential. Inspect...SuggestedMinimum wageTemporary workWork at officeLocal areaRelocation
$18.5 per hour
...outlook Attendance. Can be counted on to be on the job Pace. Consistently process 30 packages per hour Shopper. General idea of price for common consumer items Memory. Remember specials and approx. price of repeat items Why choose us? Mid-size. Big enough to...SuggestedHourly payLocal areaMonday to FridayShift workDay shift$9 - $30 per hour
...participates in E-Verify. Description About the Job The Testing Evaluator position is a remote, on demand, part-time position. The... ...geographical location, jobs availability, budget availability, revenue etc. FULL TIME/PART TIME Contingent Benefits Part-time employees...Full timePart timeFor contractorsCurrently hiringWork at officeRemote workFlexible hours$70 - $110 per hour
...weeks Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated financial plans , budgets, and forecasts for... ...financial scenarios involving cash flow oversight, budgeting, pricing decisions, and financial reporting. Provide expert feedback...Hourly payContract workSummer workWork at officeImmediate startRemote workMercor
New York, NY13 days ago- ...in risk, reinsurance and capital, people and investments, and management consulting, advising clients in 130 countries. With annual revenue of over $27 billion and more than 95,000 colleagues, Marsh helps build the confidence to thrive through the power of perspective....Work at officeLocal areaRemote workFlexible hours3 days per week1 day per week
Marsh & McLennan Companies
Perth, ND1 day ago - Overview At PAM Health, we care for chronically and critically ill patients who require extended hospital care. PAM Health has over 80 hospital locations and employs over 11,000 people across the country. Our teams work together to deliver the highest level of compassionate...Full timeLocal area
PAM Health
Humble, TX4 days ago - ...Physician Services PC · Mental HealthValhalla, NYAllied Health Prof/TechnicalPer DiemAll ShiftsAs neededJob Summary: The Mental Health Evaluator (MHE) is a critical role dedicated to delivering comprehensive, clinically appropriate, culturally competent, and trauma-informed...
HealthAlliance of the Hudson Valley
Valhalla, NY2 days ago $80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote workMercor
Houston, TX5 days ago$16 - $20 per hour
...Research Evaluator Position The research team at Penn State Ross and Carol Nese College of Nursing is hiring part-time research evaluators for projects focused on dementia care in assisted living settings. The research evaluator will assist with in-person recruitment...Hourly payPart timeSummer workPenn State University
State College, PA1 day ago- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...Contract workTemporary workImmediate startRemote work
MERIT Beauty
New York, NY3 days ago - A leading digital solutions provider is seeking a Personalized Ads Evaluator for a part-time position. This entry-level role involves reviewing online advertisements to assess their relevance to search terms, providing detailed feedback on content and cultural context....Part timeRemote work
TELUS Digital AI Data Solutions
United States4 days ago $80 - $120 per hour
...This role is for one of our clients Compensation: $80 - $120 per hour We are hiring expert Evaluators in Special education / IEP to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality...Hourly payContract workFor contractorsWork at officeRemote workWeekday AI
United States5 days ago$9 - $30 per hour
ALTA Language Services, Inc. is looking for a remote Testing Evaluator in Atlanta, GA. This part-time position involves assisting with language proficiency examinations and evaluating tests according to set criteria. Candidates should have strong communication skills, professionalism...Part timeRemote workALTA Language Services
United States4 days ago- ...Weekday 1 is seeking expert Evaluators to review AI-generated real estate, hospitality and events outputs for accuracy, rigor and domain quality. You will apply deep expertise to grade documents, spreadsheets and slide decks. Requirements include 5+ years in Real estate...Hourly payWeekly payContract workWork at officeRemote workWeekday work
Weekday 1
United States1 day ago $80 - $120 per hour
...Special Education Iep Evaluator This role is for one of our clients. Compensation: $80 - $120 per hour. We are hiring expert Evaluators in special education / IEP to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy...Hourly payRemote workWeekday
United States5 days ago$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...Hourly payPart timeRemote workFlexible hoursWelo Data
United States4 days ago- ...Shore Staffing, Inc. is seeking aMaryland Licensed Psychologistto join our growing behavioral health evaluation team. This flexible opportunity allows you toconduct comprehensive psychological evaluationsorprovide remote clinical supervision and oversight to a Psychology...ReliefPrivate practiceRemote workFlexible hours
Shore Staffing Inc
Lexington Park, MD1 day ago - ...About the role Swahili Evaluation AI Evaluator is a remote evaluation track for reviewing swahili generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback...Hourly payFor contractorsRemote work10 hours per week
AI Trainer Jobs
New York, NY4 days ago - ...Obsidian is hiring expert Evaluators in Real estate, hospitality, and events to review AI-generated work for accuracy, rigor, and domain quality. This remote position requires deep expertise and involves grading outputs like documents and presentations. Applicants...Work at officeRemote work
Obsidian
San Francisco, CA5 days ago $20 per hour
A tech company specializing in AI is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance the model’s understanding of aesthetics. An ideal candidate will have a strong background in UI/UX design and...Remote workFlexible hoursDataAnnotation
United States4 days ago$11.5 per hour
...A leading educational institution is offering a part-time remote position as an Online Task Contributor. In this role, you will evaluate and provide feedback on content to enhance search engine results and quality. No prior experience is needed, but proficiency in English...Hourly payPart timeRemote workUniversity of Delaware
United States4 days ago$14.5 per hour
...global community of over 500,000 AI training and domain experts...and we'd like you to join us! Job Description As a Web Search Evaluator, you will play a key role in improving the quality of search engine results, ensuring users find the most relevant and useful...Part timeCurrently hiringImmediate startRemote workWork from home10 hours per weekFlexible hoursJobs for Humanity
United States5 days ago$52 per hour
...application due to a disability, contact this employer to ask for an accommodation or an alternative application process. Program Evaluator Full Time Professional Honolulu, HI, US ATA Services is seeking Program Evaluators to provide evaluation and epidemiological support...Hourly payFull timeContract workLocal areaRemote workATA Services
Honolulu, HI2 days ago$14.5 per hour
...Internet! Are you curious, tech-savvy, and passionate about improving online search experiences? Join our team as a Web Search Evaluator and help shape the future of search engines from the comfort of your home! What You'll Do: As a Web Search Evaluator, you...Bi-weekly payHourly payPart timeImmediate startRemote workWork from homeFlexible hoursJobs for Humanity
Jacksonville, FL1 day ago- ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional...Work at officeRemote work
Obsidian
New York, NY1 day ago $52k - $57k
...POSITION TITLE: Program Evaluator REPORTS TO: Director of Quality BROAD FUNCTION: Collects, analyzes, and reports on data to evaluate effectiveness of program services. I. CORE VALUES: # CULTURAL PROFICIENCY: Articulates and applies historical context...Full timeSummer workLocal areaFamily Connections
East Orange, NJ1 day ago- ...A leading tech organization is seeking candidates aged 18 to 19 to evaluate North American teen humor through structured rating and comparative ranking. This role requires familiarity with teen internet culture and humor, and the ability to articulate why content resonates...Part timeFor contractorsFreelanceRemote workFlexible hours
Turing
Los Angeles, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Pricing / ROI / revenue economics Evaluator [Remote]. Be the first to apply!
