Management Evaluator - Fully Remote | Upto $120/hr
$120 per hourMercor
- Remote job
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: General business strategy / management Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors.
- Provide clear, structured written feedback.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
- Collaborate with subject matter experts to ensure consistency, relevance, and coverage across datasets.
Qualifications
Must-Have
- 5+ years of relevant professional experience in General business strategy / management .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher ) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$120 per hour
...D'Angelo , Larry Summers , and Jack Dorsey . Position: Procurement / vendor management Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$120 per hour
...Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80-$120/hour Location: Remote Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics....Remote workContract workSummer workWork at office$120 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Clinical / biomedical / pharma Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality...Remote jobContract workSummer workWork at office$120 per hour
...Larry Summers , and Jack Dorsey . Position: Investment analysis / valuation / credit Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality...Remote jobContract workSummer workWork at office$20 per hour
...English & Urdu Type Contract Compensation $15-$20/hour Location Remote Role Responsibilities Conduct fact-checking using trusted public sources and external tools. Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and...Remote jobContract workPart timeSummer work$175 per hour
...JSON-fluent & Rubrics Expert Type: Contract Compensation: $50–$175/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Evaluate JSON-formatted AI model outputs against defined grading rubrics. Read and understand...Remote jobContract workSummer workStart working today$42 per hour
...Expert - Urdu Type: Contract Compensation: $14–$42/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres and rate it against quality standards....Remote jobContract workSummer workImmediate start$160 per hour
...: Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-specific documents... ...Provide structured feedback to improve document standards and evaluation processes. Utilize Excel , PowerPoint , and Word for...Remote jobContract workSummer work$90 per hour
.... Position: ML Challenge Task Auditor Type: Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate the quality, correctness, and methodological rigor of applied machine-learning tasks for training and evaluating...Remote jobContract workSummer work$42 per hour
...Expert - Hindi Type: Contract Compensation: $14–$42/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate it against detailed quality...Remote jobContract workSummer workImmediate startFlexible hours$190 per hour
...Plug In Connectors Expert Type: Contract Compensation: $50–$190/hour Location: Remote Commitment: 20+ hours/week Role Responsibilities Evaluate AI systems on complex personal workflows, including personal health , travel , and activity...Remote jobHourly payContract workFor contractorsSummer workTrial period$42 per hour
...Expert - Hebrew Type: Contract Compensation: $17–$42/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres for quality and creativity. Compare...Remote jobContract workSummer workImmediate start$120 per hour
...Angelo, Larry Summers, and Jack Dorsey. Position: Investor materials / fundraising / pitchbook Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Responsibilities Evaluate AI-generated artifacts against domain-specific quality...Remote workContract workSummer workWork at office$120 per hour
..., Profiling) Type: Contract Compensation: $90–$120/hour Location: Remote Commitment: 40 hours/week Role Responsibilities... ...performance on ML systems and training infrastructure . Evaluate MLOps and ML systems tasks. Provide clear, written...Remote jobContract workSummer work$120 per hour
About the role We are hiring expert Evaluators in Special education / IEP to review and assess AI-generated work products (documents... ...deep subject-matter expertise to grade outputs. This is a remote, hourly engagement. Requirements (must have) 5+ years of relevant...Remote workHourly payWork at office$120 per hour
...and Jack Dorsey . Position: Domain Expert – Legal (Lexis+ Research) Type: Contract Compensation: $76–$120/hour Location: Remote Role Responsibilities Confirm every case, statute, and regulation is still good law for the point cited. Catch negative...Remote jobContract workSummer work$120 per hour
...Pharmacist Type: Contract Compensation: $75–$120/hour Location: Remote Role Responsibilities Confirm interaction, dosing,... ...Preferred ~ Prior data annotation, labeling, or AI evaluation experience Application Process (Takes 20–30 mins to...Remote jobContract workSummer work$130 per hour
...Jack Dorsey . Position: Securities & Wealth-Management Compliance / Supervisory Analyst Type:... ...Compensation: $100–$130/hour Location: Remote Commitment: 15 hours/week Role Responsibilities Evaluate completed periodic client reviews against a supervision...Remote jobContract workSummer work$80 - $120 per hour
...D'Angelo , Larry Summers , and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain...Remote workContract workSummer workWork at office$120 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Legal Expert Type: Contract Compensation: $70–$120/hour Location: Remote Role Responsibilities Review and QA AI-agent rollouts by verifying agent answers against actual dockets,...Remote jobContract workSummer work$120 per hour
...Dorsey . Position: Domain Expert – Banking (Oracle FLEXCUBE Research) Type: Contract Compensation: $75–$120/hour Location: Remote Role Responsibilities Confirm the customer/contract position reflects actual events, not assumptions, especially...Remote jobContract workSummer work$120 per hour
...Legal Expert — Environmental (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~13 hours Role Responsibilities Evaluate AI-generated legal deliverables for accuracy and preference. Review six blinded...Remote jobContract workSummer work$120 per hour
...Expert — Finance & Real Estate (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~30 hours Role Responsibilities Evaluate AI-generated legal content in finance and real estate to ensure accuracy and...Remote jobContract workSummer work$120 per hour
...Corporate & Capital Markets (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~24 hours Role Responsibilities Evaluate AI-generated legal deliverables for accuracy and preference. Review and compare...Remote jobContract workSummer work$120 per hour
...Jack Dorsey . Position: Legal Expert — Immigration (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~6 hours Role Responsibilities Read a synthetic legal matter and its underlying documents. Review...Remote jobContract workSummer work$120 per hour
.... Position: Advisory & Transaction Services Expert (M&A / Valuation) Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Design realistic scenarios from your work, including quality-of-earnings analyses, working...Remote jobContract workSummer work$120 per hour
...Position: Survey Research & Consumer Insights Expert Type: Contract Compensation: $120/hour Location: Remote Role Responsibilities Review and evaluate surveys for methodological quality, clarity, and fitness for purpose. Assess survey questions...Remote jobContract workSummer work$120 per hour
...Disputes & International (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~24 hours Role Responsibilities Evaluate AI-generated legal content in disputes and international law to determine preference....Remote jobContract workSummer work$120 per hour
...Jack Dorsey . Position: Private Equity Associate – Real Estate (US) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: 20–25 hours/week Role Responsibilities Build a working financial model of an assigned real estate...Remote jobContract workFor contractorsSummer work$120 per hour
...Research Expert Type: Contract Compensation: $120/hour Location: Remote Duration: Minimum four weeks Commitment: 10+ hours... ...public SEC filings to support AI model training . Evaluate the accuracy of AI-generated equity research to enhance...Remote jobHourly payContract workFor contractorsSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Management Evaluator - Fully Remote | Upto $120/hr. Be the first to apply!
- clinical evaluator New York, NY
- ai evaluator New York, NY
- quality evaluator New York, NY
- social media evaluator New York, NY
- education evaluator New York, NY
- program evaluator New York, NY
- work from home web search evaluator New York, NY
- evaluator New York, NY
- remote reviewer New York, NY
- remote veterinarian New York, NY


