Critical Reviewer - Fully Remote | Upto $70/hr
$70 per hourMercor
- Remote job
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist Expert
Type: Contract
Compensation: $70/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated responses to strengthen reasoning and rigor in model outputs .
- Provide structured written feedback to improve training data quality and downstream performance.
- Develop clear, precise, and well-evidenced written rationales beyond surface-level observations.
- Apply strict attention to detail and accurate application of structured evaluation guidelines.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- Bachelor's degree from a top-500 globally ranked university preferred.
- Strong analytical and written communication skills.
- Ability to work independently and follow detailed task guidelines.
- Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning.
- Ability to write clear, precise, and well-evidenced written rationales.
- Consistent and honest judgment, including the ability to give critical assessments.
- Strict attention to detail and accurate application of structured evaluation guidelines.
- Ability to work entirely without AI writing tools .
- Native English fluency required.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$70 per hour
...Type: Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate... ...consistent and honest judgment, including critical assessments when warranted. Work... ...: ****@*****.*** PS: Our team reviews applications daily. Please complete...Remote workContract workSummer work$70 per hour
...macOS - Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate and utilize Word on macOS for long-form document authoring and review. Develop expertise in styles, referencing, and review...Remote jobContract workSummer workFlexible hours$70 per hour
...Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation: $50–$70/hour Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for quality and correctness....Remote jobContract workSummer workFlexible hours$55 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Wholesale and Technical Sales Reviewer Type: Contract Compensation: $50–$55/hour Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated content in wholesale...Remote workContract workSummer work$90 per hour
...'Angelo , Larry Summers , and Jack Dorsey . Position: Finance & Insurance Practice Reviewer Type: Contract Compensation: $75–$90/hour Location: Remote Role Responsibilities Evaluate AI-generated work in finance and insurance to ensure...Remote jobContract workSummer workFlexible hours$55 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Public Sector Practice Reviewer Type: Contract Compensation: $50–$55/hour Location: Remote Role Responsibilities Evaluate the realism of AI-generated tasks in public sector roles...Remote jobContract workSummer work$160 per hour
...Dorsey . Position: Job Seeker - New Grad Type: Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-specific documents for quality and accuracy. Provide structured feedback to ensure relevance...Remote workContract workSummer workFlexible hours$120 per hour
...: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against... ...or support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobContract workSummer workWork at office$120 per hour
...Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... ...structured written feedback to improve AI-generated content. Review documents, spreadsheets, and slide decks for accuracy and rigor....Remote jobContract workSummer workWork at office$60 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Code Plan Reviewer (Plans Examiner) — Vulcan Type: Contract Compensation: $45–$60/hour Location: Remote Role Responsibilities Develop evaluation tasks using real permit review work...Remote jobHourly payContract workFor contractorsSummer work$20 per hour
...Type: Contract Compensation: $15–$20/hour Location: Remote Commitment: 20 hours/week Role Responsibilities... ...Categorize issues and mark the exact span where they occur using our review tooling. Report on overall listener satisfaction and identify...Remote jobContract workPart timeSummer work$12 per hour
...Type: Contract Compensation: $13/hour Location: Remote Role Responsibilities Source documents: find a publicly accessible... ...dimensions, and flags for tables, formulas, and handwriting. Review a colleague's work: every task is reviewed end to end by a...Remote jobContract workSummer work$70 per hour
...Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate... ...compliance, and overall quality. Review content involving misinformation, political... ...field. ~ Excellent written English , critical thinking, and analytical reasoning...Remote jobContract workSummer work$60 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product Reviewer – AI Web Application Specifications Type: Contract Compensation: $30–$60/hour Location: Remote Role Responsibilities Review AI-generated product specifications...Remote jobContract workSummer work$70 per hour
...Detection Experts Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct enterprise fraud... ..., reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobContract workSummer work$70 per hour
...Data for Autonomous Systems annotation Type: Contract Compensation: $50–$70/hour Location: Remote Commitment: 30–40 hours/week Role Responsibilities Review real-world data from deployed networks, including logs, configs, telemetry, and event...Remote jobContract workSummer work$70 per hour
...Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate and utilize Windows... ..., reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobContract workSummer work$70 per hour
...Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate the usability and... ...support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobContract workSummer work$70 per hour
...Position: Non-Investment Finance Expert (CL Funnel) Type: Contract Compensation: $70/hour Location: Remote Role Responsibilities Build and review deliverables such as PnL and mark-to-market reconciliations , vendor payment reconciliations,...Remote workFull timeContract workSummer work$70 per hour
...Education Expert Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct higher education... ...curriculum and program design, faculty senate or accreditation review, and budget or enrollment planning. Build education...Remote jobContract workSummer work$70 per hour
...Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Utilize Excel for... ...support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobContract workSummer work$70 per hour
...Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week... ...code in Docker . Preferred Publications in peer-reviewed journals. Prior scientific software or research engineering...Remote jobContract workSummer workImmediate start$70 per hour
...Search Expert Type: Contract Compensation: $40–$70/hour Location: Remote Role Responsibilities Evaluate the accuracy and... ...to strengthen reasoning and rigor in model outputs . Review complex content for alignment with domain principles and methodologies...Remote jobContract workSummer work$70 per hour
...Position: Electrical Engineer, Power Stations Type: Contract Compensation: $70/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities Review tasks on power station electrical systems, including circuit and control design ,...Remote jobContract workFor contractorsSummer workImmediate start$70 per hour
...Education Expert Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct higher education... ...for curriculum and program design, faculty senate reviews, and institutional planning cycles. Build education tasks...Remote jobContract workSummer work$70 per hour
...Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week... ...code in Docker . Preferred Publications in peer-reviewed journals. Prior scientific software or research engineering...Remote jobContract workSummer workImmediate start$70 per hour
..., MS, PhD's) Type: Contract Compensation: $50–$70/hour Location: Remote Duration: 1–2 month minimum, extension likely Commitment... ..., reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobContract workSummer workImmediate start$70 per hour
...Analytics Experts Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct enterprise data... ..., reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobContract workSummer work$70 per hour
...Chain Expert Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct enterprise supply chain... ...of how F500 sourcing, procurement, and vendor contract review actually work. Preferred ~ Prior rubric, supply...Remote jobContract workSummer work$70 per hour
...Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week... ...code in Docker . Preferred Publications in peer-reviewed journals. Prior scientific software or research engineering...Remote jobContract workSummer workImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Critical Reviewer - Fully Remote | Upto $70/hr. Be the first to apply!
- remote data manager San Francisco, CA
- remote property manager San Francisco, CA
- office manager remote San Francisco, CA
- it manager remote San Francisco, CA
- remote video game San Francisco, CA
- node js remote San Francisco, CA
- junior data engineer remote San Francisco, CA
- excel remote San Francisco, CA
- remote medical data entry San Francisco, CA
- react node js developer (remote) San Francisco, CA


