Pricing / ROI / revenue economics Evaluator [Remote]
$80 - $120 per hourAuraOne Human Data
Remote
- Remote job
Pricing / ROI / revenue economics Evaluator is a remote evaluation track for reviewing pricing / roi / revenue economics evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team can use to retrain.
Why this role matters
AI data reviewers help turn pricing / roi / revenue economics evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.
Responsibilities
- Evaluate pricing / roi / revenue economics evaluation model outputs against a versioned rubric and assign severity tags for Pricing / ROI / revenue economics Evaluator assignments.
- Compare paired responses and pick the stronger answer with a written rationale.
- Label hallucinations, instruction-following failures, and unsafe content with structured tags.
- Capture ambiguous prompts and route them back to the program team for rubric updates.
- Maintain reviewer-quality scores by calibrating against gold-standard examples each week.
- Document recurring failure modes so the modeling team can target them in the next training run.
Qualifications
- Prior evaluation, annotation, or human-rater experience on pricing / roi / revenue economics evaluation or adjacent content for Pricing / ROI / revenue economics Evaluator work.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that names the issue and the rubric clause being applied.
- Strong attention to detail and the ability to flag when a prompt itself is the problem.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Compare two pricing / roi / revenue economics evaluation model responses to the same prompt and pick the stronger one with rationale.
- Tag an unsafe response with the correct policy category and severity.
- Audit a 50-row batch for rubric consistency and report drift to the program lead.
- Propose a rubric clarification after spotting a recurring failure mode.
Nice to have
- Background in linguistics, content moderation, or trust & safety review.
- Experience with inter-rater agreement metrics and calibration cycles.
- Domain expertise that lets you spot subject-matter errors automated checks miss.
Skills
- Model output evaluation
- Rubric-based annotation
- Severity tagging
- Inter-rater calibration
- Pricing / ROI / revenue economics evaluation
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
$80–$120 / hr
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
Vacancy posted 20 days ago
Similar jobs that could be interesting for youBased on the Pricing / ROI / revenue economics Evaluator [Remote] in Remote vacancy
$80 - $120 per hour
...Role Overview Assess AI-generated pricing, ROI, and revenue economics work products for accuracy, rigor, and domain quality. You will review documents... ...and deliverable quality. Key Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics...SuggestedHourly payWork at officeRemote workSaidGig
United States9 days ago$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedContract workSummer workWork at officeRemote workMercor
San Francisco, CA7 days ago$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedContract workSummer workWork at officeRemote work$425 per month
...these values, we welcome you to explore our contractor opportunities! Requirements: This position pays up to 50% of revenue , 1-Day Evaluation $350 for remote and $425 for in person, 2-Day Evaluation $742.00 for in person. POSITION SUMMARY The Vocational Evaluator...SuggestedFull timeFor contractorsWork experience placementWork at officeLocal areaRemote work- ...quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content, craft relevant questions... ...quantitative methods such as stochastic modeling, derivatives pricing, econometrics, risk modeling, or computational finance Strong...SuggestedFull timeContract workRemote workFlexible hours
Virtual Vocations Inc
United States1 day ago - ...Commercial Evaluator | Outside Sales Arrow Exterminators is looking to hire a highly motivated individual to fill a full-time Outside... ...offer a more personalized approach to our communities. Ranked by revenue, Atlanta-based Arrow Exterminators is the sixth-largest pest...Full timeTemporary workHome office
- ...The Mental Health Evaluator (MHE) is a critical role dedicated to delivering comprehensive, clinically appropriate, culturally competent, and trauma-informed patient behavioral health interventions in the hospital Emergency Department. Responsibilities include conducting...
WMCHealth
Poughkeepsie, NY7 days ago - Overview At PAM Health, we care for chronically and critically ill patients who require extended hospital care. PAM Health has over 80 hospital locations and employs over 11,000 people across the country. Our teams work together to deliver the highest level of compassionate...Full timeLocal area
- Title: Forensic EvaluatorState Role Title: Psych III/Psychology Assoc IIIHiring Range: $123,326.00 - $161,762.00Pay Band: 6Agency: Dept Behavioral Health/DevelopLocation: Va Center for Behavioral RehabAgency Website: Type: General Public - GJob DutiesThis position has ...Work experience placementWork at officeLocal areaRemote work
$12.65k
...state tax agency. The Montana Department of Revenue administers almost 40 state taxes,... ...and limiting conditions. * Analyze and evaluate appraisal information to determine final... ...secondary education in business, accounting, economics, public administration, construction...Full timeWork experience placementWork at officeRemote workFlexible hoursState of Montana
Ennis, MT5 days ago$51.07k - $76.61k
...bathrooms. Measures physical depreciation and functional and economic obsolescence of the structure. Measures and list... ...Must complete and pass IAAO course 101 and Department of Revenue course Property Tax Listing and Assessing within two (2) years...16 hoursPermanent employmentFull timeTemporary workPart timeZero hours contractLocal areaImmediate startFlexible hoursUnion County, NC
Monroe, NC2 days ago$33 - $36 per hour
...receiving close to 90% of State Trust Land revenues. Through the application of sound... ...Guidelines; advising on selected valuation and evaluation assignments; making recommendations on... ...related issues and collection of economic data in support of the appraisal process...Hourly payFull timeContract workPart timeWork at officeLocal areaRemote workArizona Department of Administration
United States5 days ago- ...collection and market research for commercial real estate valuation projects Analyze complex scenarios related to highest and best use, revenue, and expense performance Mentor less experienced professionals and manage client relationships to develop new business Required...Full timeRemote work
Virtual Vocations Inc
United States3 days ago - ...that we provide through our programs help minimize barriers and lead to increased self-sufficiency. We're currently looking for an Evaluator & Inspector for our WCCA Weatherization Program.The Evaluator / Inspector will estimate and draw up specifications and...Contract workFor contractorsWork experience placementWork at officeWork from home
Iowa Community Action Association - West Central Community A...
Harlan, IA4 days ago $14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...Hourly payPart timeRemote workFlexible hoursWelo Data
New York, NY5 days ago$37 per hour
...health solutions in the public sector. Job Summary and Responsibilities Job Summary Join Acentra Health as a Clinical Evaluator (PASRR) in North Carolina. In this role, you will conduct PASRR Level II Pre-Admission Screening and Resident Review assessments,...Hourly payReliefWork at officeLocal areaRemote workWork from homeHome officeAcentra Health
Hickory, NC4 days ago$20 - $30 per hour
...Hours Per Week 40 Number Of Positions 25 Shift Unspecified Job Description We are seeking a Social Media Ads Evaluator. In this Independent Contractor role, you will evaluate the relevance, appropriateness, and accuracy of social media advertisements...Hourly payContract workFor contractorsRemote workShift workEDVOCATE SOLUTIONS, LLC
Toms River, NJ3 days ago- ...Alignerr is seeking a Search Quality Evaluator to assess search engine results, AI-generated answers, and content recommendations. This fully remote, flexible contract role values strong critical thinking and quality instincts, with no technical background required beyond...Contract workRemote workFlexible hours
Alignerr
Peru, IL14 hours ago $16 - $20 per hour
...DESCRIPTION AND POSITION REQUIREMENTS The research team at Penn State Ross and Carol Nese College of Nursing is hiring part‑time research evaluators for projects focused on dementia care in assisted living settings. The research evaluator will assist with in‑person recruitment,...Hourly payPart timeSummer workThe Pennsylvania State University
Hershey, PA5 days ago- ...Web Browsing Evaluator Contractor Remote Micro1 is engaging Web Browsing Evaluators to contribute high-quality web interaction data for a valued customer project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will...For contractorsRemote work
ESR Healthcare
New York, NY2 days ago - ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional...Work at officeRemote work
Obsidian
New York, NY4 days ago $80 - $120 per hour
...Program Management / Implementation Planning Evaluator $80-$120 / hr Hourly contract Remote About the role We are hiring expert Evaluators in Program management / implementation planning to review and assess AI-generated work products (documents, spreadsheets...Hourly payContract workFor contractorsWork at officeRemote workDorado
United States4 days ago- ...Luxury Brand Evaluator Turn your passion for luxury into a career opportunity. Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in customer experience, and work alongside iconic names...Remote workWorldwideFlexible hours
CXG
United States1 day ago $52k - $57k
...POSITION TITLE: Program Evaluator REPORTS TO: Director of Quality BROAD FUNCTION: Collects, analyzes, and reports on data to evaluate effectiveness of program services. I. CORE VALUES: # CULTURAL PROFICIENCY: Articulates and applies historical context...Full timeSummer workLocal areaFamily Connections
East Orange, NJ4 days ago$40 per hour
A cybersecurity training company is seeking experienced professionals to evaluate AI-generated security content and solve technical problems. This is a remote role offering flexibility in project selection and scheduling. Ideal candidates will have over 2 years of cybersecurity...Hourly payRemote workDataAnnotation
Lincoln, NE5 days ago$80 - $120 per hour
...Program Management / Implementation Planning Evaluator This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Program Management / Implementation Planning Evaluator based in Canada. This contract...Hourly payContract workWork at officeRemote workFlexible hoursJobgether
United States1 day ago$14.5 per hour
...AI Web Search Evaluator Unlock the Power of the Internet! Are you curious, tech-savvy, and passionate about improving online search experiences? Join our team as a Web Search Evaluator and help shape the future of search engines from the comfort of your home! As...Bi-weekly payHourly payPart timeImmediate startRemote workWork from homeFlexible hoursJobs for Humanity
United States2 days ago$40 per hour
A leading tech firm is seeking experienced cybersecurity professionals to evaluate AI-generated security content and solve technical problems. This role requires at least 2 years of hands-on experience in areas such as penetration testing and incident response. Candidates...Hourly payRemote workDataAnnotation
Louisiana, MO5 days ago$9 - $30 per hour
ALTA Language Services, Inc. is looking for a remote Testing Evaluator in Atlanta, GA. This part-time position involves assisting with language proficiency examinations and evaluating tests according to set criteria. Candidates should have strong communication skills, professionalism...Part timeRemote workALTA Language Services
Atlanta, GA5 days ago- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...Contract workTemporary workImmediate startRemote work
MERIT Beauty
New York, NY1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Pricing / ROI / revenue economics Evaluator [Remote]. Be the first to apply!
