Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Critical Reviewer - Fully Remote | Upto $70/hr

$70 per hour

Mercor

New York, NY
  • Remote job

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Generalist Expert
Type: Contract
Compensation: $70/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated responses to strengthen reasoning and rigor in model outputs .
  • Provide structured written feedback to improve training data quality and downstream performance.
  • Develop clear, precise, and well-evidenced written rationales that go beyond surface-level observations.
  • Ensure consistent and honest judgment, including critical assessments when warranted.
  • Work independently and asynchronously to meet deadlines while improving AI model performance .

Qualifications

Must-Have

  • Bachelor's degree from a top-500 globally ranked university preferred.
  • Strong analytical and written communication skills.
  • Ability to work independently and follow detailed task guidelines.
  • Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning.
  • Native English fluency required.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the Critical Reviewer - Fully Remote | Upto $70/hr in New York, NY vacancy
  • $70 per hour

     ...Type: Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate...  ...detailed task guidelines. Strong critical reading skills with the ability to identify...  ...: ****@*****.*** PS: Our team reviews applications daily. Please complete... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    20 days ago
  • $70 per hour

     ...Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation: $50–$70/hour Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for quality and correctness.... 
    Remote job
    Contract work
    Summer work
    Flexible hours

    Mercor

    New York, NY
    27 days ago
  • $90 per hour

     ...'Angelo , Larry Summers , and Jack Dorsey . Position: Finance & Insurance Practice Reviewer Type: Contract Compensation: $75–$90/hour Location: Remote Role Responsibilities Evaluate AI-generated work in finance and insurance to ensure... 
    Remote job
    Contract work
    Summer work
    Flexible hours

    Mercor

    New York, NY
    8 days ago
  • $55 per hour

     ...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Public Sector Practice Reviewer Type: Contract Compensation: $50–$55/hour Location: Remote Role Responsibilities Evaluate the realism of AI-generated tasks in public sector roles... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    8 days ago
  • $60 per hour

     ...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product Reviewer – AI Web Application Specifications Type: Contract Compensation: $30–$60/hour Location: Remote Role Responsibilities Review AI-generated product specifications... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    23 days ago
  • $120 per hour

     ...: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against...  ...or support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    San Francisco, CA
    29 days ago
  • $55 per hour

     ...Angelo , Larry Summers , and Jack Dorsey . Position: Wholesale and Technical Sales Reviewer Type: Contract Compensation: $50–$55/hour Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated content in wholesale... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    27 days ago
  • $120 per hour

     ...Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...  ...structured written feedback to improve AI-generated content. Review documents, spreadsheets, and slide decks for accuracy and rigor.... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    New York, NY
    14 days ago
  • $20 per hour

     ...Type: Contract Compensation: $15–$20/hour Location: Remote Commitment: 20 hours/week Role Responsibilities...  ...Categorize issues and mark the exact span where they occur using our review tooling. Report on overall listener satisfaction and identify... 
    Remote job
    Contract work
    Part time
    Summer work

    Mercor

    San Francisco, CA
    17 days ago
  • $60 per hour

     ...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Code Plan Reviewer (Plans Examiner) — Vulcan Type: Contract Compensation: $45–$60/hour Location: Remote Role Responsibilities Develop evaluation tasks using real permit review work... 
    Remote job
    Hourly pay
    Contract work
    For contractors
    Summer work

    Mercor

    New York, NY
    17 days ago
  • $160 per hour

     ...Dorsey . Position: Job Seeker - New Grad Type: Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-specific documents for quality and accuracy. Provide structured feedback to ensure relevance... 
    Remote job
    Contract work
    Summer work
    Flexible hours

    Mercor

    San Francisco, CA
    8 days ago
  • $12 per hour

     ...Type: Contract Compensation: $13/hour Location: Remote Role Responsibilities Source documents: find a publicly accessible...  ...dimensions, and flags for tables, formulas, and handwriting. Review a colleague's work: every task is reviewed end to end by a... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    7 days ago
  • $70 per hour

     ...Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate...  ...compliance, and overall quality. Review content involving misinformation, political...  ...field. ~ Excellent written English , critical thinking, and analytical reasoning... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    20 days ago
  • $70 per hour

     ...Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate and utilize Windows...  ..., reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    18 days ago
  • $70 per hour

     ...Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate the usability and...  ...support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    15 days ago
  • $70 per hour

     ...-Phase Insights Type: Contract Compensation: $70 total Location: Remote Duration: Approximately 20 minutes Role Responsibilities...  ..., reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    14 days ago
  • $70 per hour

     ...Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Utilize Excel for...  ...support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    7 days ago
  •  ...hybrid role that is predominantly remote, with limited on-site...  ...customer retention rate, with over 70% of our clients having been with...  ...a communicator. You can think critically, identify opportunities, and...  ...goes up, so does our pay. Fully remote roles, you can work from... 
    Remote work
    Live out
    Currently hiring
    Flexible hours

    DataServ

    Saint Louis, MO
    2 days ago
  • $70 per hour

     ...Search Expert Type: Contract Compensation: $40–$70/hour Location: Remote Role Responsibilities Evaluate the accuracy and...  ...to strengthen reasoning and rigor in model outputs . Review complex content for alignment with domain principles and methodologies... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    18 days ago
  • $70 per hour

     ...Position: Non-Investment Finance Expert (CL Funnel) Type: Contract Compensation: $70/hour Location: Remote Role Responsibilities Build and review deliverables such as PnL and mark-to-market reconciliations , vendor payment reconciliations,... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    12 days ago
  • $70 per hour

     ...Position: Electrical Engineer, Power Stations Type: Contract Compensation: $70/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities Review tasks on power station electrical systems, including circuit and control design ,... 
    Remote job
    Contract work
    For contractors
    Summer work
    Immediate start

    Mercor

    New York, NY
    12 days ago
  • $70 per hour

     ...Position: Senior Civil Legal Paralegal / Accredited Representative Type: Contract Compensation: $70/hour Location: Remote Role Responsibilities Review AI-generated legal guidance for accuracy and relevance in civil legal services. Evaluate... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    14 days ago
  • $70 per hour

     ...Education Expert Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct higher education...  ...for curriculum and program design, faculty senate reviews, and institutional planning cycles. Build education tasks... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    27 days ago
  • $70 per hour

     ...Education Expert Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct higher education...  ...curriculum and program design, faculty senate or accreditation review, and budget or enrollment planning. Build education... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    22 days ago
  • $70 per hour

     ...Position: Pharmacist Type: Contract Compensation: $70/hour Location: Remote Commitment: 30–40 hours/week Role Responsibilities...  ...context, source materials, and labelling guidelines. Review AI-generated responses for clinical accuracy, safety,... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    20 days ago
  • $70 per hour

     ...Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week...  ...code in Docker . Preferred Publications in peer-reviewed journals. Prior scientific software or research engineering... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    San Francisco, CA
    8 days ago
  • $70 per hour

     ..., MS, PhD's) Type: Contract Compensation: $50–$70/hour Location: Remote Duration: 1–2 month minimum, extension likely Commitment...  ..., reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    New York, NY
    19 days ago
  • $70 per hour

     ...Detection Experts Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct enterprise fraud...  ..., reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    20 days ago
  • $70 per hour

     ...Marketing Expert Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct enterprise sales...  ...plus understanding of F500 budgets, procurement, and legal review. Preferred ~ Prior rubric, sales-enablement... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    12 days ago
  • $70 per hour

     ...Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week...  ...code in Docker . Preferred Publications in peer-reviewed journals. Prior scientific software or research engineering... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    San Francisco, CA
    23 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Critical Reviewer - Fully Remote | Upto $70/hr. Be the first to apply!