Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Critical Reviewer - Fully Remote | Upto $70/hr

$70 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Generalist Expert
Type: Contract
Compensation: $70/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated responses to strengthen reasoning and rigor in model outputs .
  • Provide structured written feedback to improve training data quality and downstream performance.
  • Develop clear, precise, and well-evidenced written rationales beyond surface-level observations.
  • Apply strict attention to detail and accurate application of structured evaluation guidelines.
  • Work independently and asynchronously to meet deadlines while improving AI model performance .

Qualifications

Must-Have

  • Bachelor's degree from a top-500 globally ranked university preferred.
  • Strong analytical and written communication skills.
  • Ability to work independently and follow detailed task guidelines.
  • Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning.
  • Ability to write clear, precise, and well-evidenced written rationales.
  • Consistent and honest judgment, including the ability to give critical assessments.
  • Strict attention to detail and accurate application of structured evaluation guidelines.
  • Ability to work entirely without AI writing tools .
  • Native English fluency required.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 29 days ago
Similar jobs that could be interesting for youBased on the Critical Reviewer - Fully Remote | Upto $70/hr in New York, NY vacancy
  • $70 per hour

     ...Type: Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate...  ...detailed task guidelines. Strong critical reading skills with the ability to identify...  ...: ****@*****.*** PS: Our team reviews applications daily. Please complete... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    12 days ago
  • $70 per hour

     ...macOS - Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate and utilize Word on macOS for long-form document authoring and review. Develop expertise in styles, referencing, and review... 
    Remote job
    Contract work
    Summer work
    Flexible hours

    Mercor

    New York, NY
    16 days ago
  • $70 per hour

     ...Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation: $50–$70/hour Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for quality and correctness.... 
    Remote job
    Contract work
    Summer work
    Flexible hours

    Mercor

    New York, NY
    14 days ago
  • $55 per hour

     ...Angelo , Larry Summers , and Jack Dorsey . Position: Wholesale and Technical Sales Reviewer Type: Contract Compensation: $50–$55/hour Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated content in wholesale... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    25 days ago
  • $160 per hour

     ...Dorsey . Position: Job Seeker - New Grad Type: Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-specific documents for quality and accuracy. Provide structured feedback to ensure relevance... 
    Remote work
    Contract work
    Summer work
    Flexible hours

    Mercor

    New York, NY
    29 days ago
  • $70 per hour

     ...Expert (PhD) — AI Safety Type: Contract Compensation: $65–$70/hour Location: Remote Commitment: 15–40 hours/week Role Responsibilities...  ...synthesis, or hazardous-materials handling. Experience reviewing, grading, or red-teaming technical content. Start Date... 
    Remote work
    Contract work
    Part time
    Summer work
    Immediate start

    Mercor Inc

    United States
    1 day ago
  • $70 per hour

     ...Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week...  ...code in Docker . Preferred Publications in peer-reviewed journals. Prior scientific software or research engineering... 
    Remote work
    Contract work
    Summer work
    Immediate start

    Mercor

    San Francisco, CA
    18 days ago
  • $70 per hour

     ...Analytics Experts Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct enterprise data...  ..., reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and... 
    Remote work
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    29 days ago
  • $70 per hour

     ...Coordinator - AI & Data Projects Type: Contract Compensation: $45-$70/hour Location: Remote Role Responsibilities Act as a day-to-day point of contact...  ...as the program expands. Participate in weekly business reviews. Organize notes and action items. Lead calls when necessary... 
    Remote job
    Contract work
    Summer work
    Flexible hours

    mercor

    New York, NY
    2 days ago
  • $120 per hour

     ...: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against...  ...or support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    San Francisco, CA
    6 days ago
  • $120 per hour

     ...Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...  ...structured written feedback to improve AI-generated content. Review documents, spreadsheets, and slide decks for accuracy and rigor.... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    New York, NY
    12 days ago
  • $55 per hour

     ...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Public Sector Practice Reviewer Type: Contract Compensation: $50–$55/hour Location: Remote Role Responsibilities Evaluate the realism of AI-generated tasks in public sector roles... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    6 days ago
  • $90 per hour

     ...'Angelo , Larry Summers , and Jack Dorsey . Position: Finance & Insurance Practice Reviewer Type: Contract Compensation: $75–$90/hour Location: Remote Role Responsibilities Evaluate AI-generated work in finance and insurance to ensure... 
    Remote job
    Contract work
    Summer work
    Flexible hours

    Mercor

    New York, NY
    6 days ago
  • $60 per hour

     ...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product Reviewer – AI Web Application Specifications Type: Contract Compensation: $30–$60/hour Location: Remote Role Responsibilities Review AI-generated product specifications... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    21 days ago
  • $60 per hour

     ...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Code Plan Reviewer (Plans Examiner) — Vulcan Type: Contract Compensation: $45–$60/hour Location: Remote Role Responsibilities Develop evaluation tasks using real permit review work... 
    Remote job
    Hourly pay
    Contract work
    For contractors
    Summer work

    Mercor

    New York, NY
    15 days ago
  • $20 per hour

     ...Type: Contract Compensation: $15–$20/hour Location: Remote Commitment: 20 hours/week Role Responsibilities...  ...Categorize issues and mark the exact span where they occur using our review tooling. Report on overall listener satisfaction and identify... 
    Remote job
    Contract work
    Part time
    Summer work

    Mercor

    San Francisco, CA
    15 days ago
  • $12 per hour

     ...Type: Contract Compensation: $13/hour Location: Remote Role Responsibilities Source documents: find a publicly accessible...  ...dimensions, and flags for tables, formulas, and handwriting. Review a colleague's work: every task is reviewed end to end by a... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    9 days ago
  • $70 per hour

     ...Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate...  ...compliance, and overall quality. Review content involving misinformation, political...  ...field. ~ Excellent written English , critical thinking, and analytical reasoning... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    4 days ago
  • $65k - $72k

     ...The Document Control Specialist, HR, will build the structure...  ...& Records Management (approx.. 70%): Design and implement a master...  ...version control and audit trails. Review and edit correspondence for...  ...Primary Work Location: This is a remote position; ideal applicants will... 
    Remote work
    Local area
    Work visa

    Vantage Group

    Sacramento, CA
    4 days ago
  • $70k - $80k

     ...Magnolia Tax Services is hiring a Senior Tax Reviewer to review business and individual returns...  ...anchor for our preparer team. This is a fully remote, full-time role open to candidates living...  ...welcome Benefits - Base salary: $70,000 to $80,000, based on experience and... 
    Remote work
    Full time
    Live in

    Magnolia Tax Services

    Illinois
    22 days ago
  •  ...for Medicare & Medicaid Services (CMS) reviewing the prior authorization (PA) and step therapy...  ...fixed deadlines Strong analytical, critical thinking, problem-solving, and decision...  ...Working Conditions: US-based fully remote/work-from-home position PRN position... 
    Remote work
    Contract work
    Temporary work
    Relief
    Seasonal work
    Work at office
    Work from home

    Rainmakers Strategic Solutions

    Remote
    8 days ago
  • $70 per hour

     ...Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate and utilize Windows...  ..., reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    7 days ago
  •  ...Behavioral Health Utilization Management Reviewer, you'll play a vital role in ensuring...  ...training/onboarding – this position is fully remote. Candidate must hold professional license...  .... Strong clinical assessment and critical thinking skills. Excellent written and... 
    Remote work
    Hourly pay

    Baystate Health

    New York, NY
    4 days ago
  • $30 per hour

     ...KLDiscovery Document Reviewer KLDiscovery, a leading global provider...  ...U.S. attorneys for ongoing remote Document Review projects....  ...project needs and client approval. Fully remote work-from-home...  ...Excellent attention to detail, critical thinking, and ability to follow... 
    Remote work
    Temporary work
    Work from home
    Home office

    KLDiscovery

    United States
    5 days ago
  • $70 per hour

     ...Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate the usability and...  ...support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    13 days ago
  • $47.84k - $58.24k

     ...Description JOB SUMMARY: This is a fully remote position. Responsible for examining and analyzing documents...  ...relevance in legal or regulatory contexts. This role is critical in litigation, compliance, and operational review processes, helping the firm identify key evidence... 
    Remote work
    Full time
    Work experience placement
    H1b
    Work at office

    McCalla Raymer Leibert Pierce LLP

    Remote
    6 days ago
  • $70 per hour

     ...Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Utilize Excel for...  ...support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    5 days ago
  • $77 per hour

     ...Position: DevSecOps Engineer Type: Contract Compensation: $70–$77/hour Location: Remote Role Responsibilities Maintain AWS infrastructure as code...  ...engineering tools (e.g., GitHub Copilot , Claude ) to author and review infrastructure. Qualifications Must-Have Hands-on AWS... 
    Remote work
    Contract work
    Summer work

    Mercor Inc

    United States
    8 hours ago
  • $70 per hour

     ...Search Expert Type: Contract Compensation: $40–$70/hour Location: Remote Role Responsibilities Evaluate the accuracy and...  ...to strengthen reasoning and rigor in model outputs . Review complex content for alignment with domain principles and methodologies... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    12 days ago
  • $70 per hour

     ...Position: Electrical Engineer, Power Stations Type: Contract Compensation: $70/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities Review tasks on power station electrical systems, including circuit and control design ,... 
    Remote job
    Contract work
    For contractors
    Summer work
    Immediate start

    Mercor

    New York, NY
    10 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Critical Reviewer - Fully Remote | Upto $70/hr. Be the first to apply!