Critical Reviewer - Fully Remote | Upto $70/hr
$70 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist Expert
Type: Contract
Compensation: $70/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated responses to strengthen reasoning and rigor in model outputs .
- Provide structured written feedback to improve training data quality and downstream performance.
- Develop clear, precise, and well-evidenced written rationales beyond surface-level observations.
- Apply strict attention to detail and accurate application of structured evaluation guidelines.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- Bachelor's degree from a top-500 globally ranked university preferred.
- Strong analytical and written communication skills.
- Ability to work independently and follow detailed task guidelines.
- Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning.
- Ability to write clear, precise, and well-evidenced written rationales.
- Consistent and honest judgment, including the ability to give critical assessments.
- Strict attention to detail and accurate application of structured evaluation guidelines.
- Ability to work entirely without AI writing tools .
- Native English fluency required.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$70 per hour
...Type: Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate... ...detailed task guidelines. Strong critical reading skills with the ability to identify... ...: ****@*****.*** PS: Our team reviews applications daily. Please complete...Remote jobContract workSummer work$70 per hour
...macOS - Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate and utilize Word on macOS for long-form document authoring and review. Develop expertise in styles, referencing, and review...Remote jobContract workSummer workFlexible hours$70 per hour
...Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation: $50–$70/hour Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for quality and correctness....Remote jobContract workSummer workFlexible hours$55 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Wholesale and Technical Sales Reviewer Type: Contract Compensation: $50–$55/hour Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated content in wholesale...Remote jobContract workSummer work$160 per hour
...Dorsey . Position: Job Seeker - New Grad Type: Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-specific documents for quality and accuracy. Provide structured feedback to ensure relevance...Remote workContract workSummer workFlexible hours$70 per hour
...Expert (PhD) — AI Safety Type: Contract Compensation: $65–$70/hour Location: Remote Commitment: 15–40 hours/week Role Responsibilities... ...synthesis, or hazardous-materials handling. Experience reviewing, grading, or red-teaming technical content. Start Date...Remote workContract workPart timeSummer workImmediate start$70 per hour
...Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week... ...code in Docker . Preferred Publications in peer-reviewed journals. Prior scientific software or research engineering...Remote workContract workSummer workImmediate start$70 per hour
...Analytics Experts Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct enterprise data... ..., reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote workContract workSummer work$70 per hour
...Coordinator - AI & Data Projects Type: Contract Compensation: $45-$70/hour Location: Remote Role Responsibilities Act as a day-to-day point of contact... ...as the program expands. Participate in weekly business reviews. Organize notes and action items. Lead calls when necessary...Remote jobContract workSummer workFlexible hours$120 per hour
...: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against... ...or support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobContract workSummer workWork at office$120 per hour
...Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... ...structured written feedback to improve AI-generated content. Review documents, spreadsheets, and slide decks for accuracy and rigor....Remote jobContract workSummer workWork at office$55 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Public Sector Practice Reviewer Type: Contract Compensation: $50–$55/hour Location: Remote Role Responsibilities Evaluate the realism of AI-generated tasks in public sector roles...Remote jobContract workSummer work$90 per hour
...'Angelo , Larry Summers , and Jack Dorsey . Position: Finance & Insurance Practice Reviewer Type: Contract Compensation: $75–$90/hour Location: Remote Role Responsibilities Evaluate AI-generated work in finance and insurance to ensure...Remote jobContract workSummer workFlexible hours$60 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product Reviewer – AI Web Application Specifications Type: Contract Compensation: $30–$60/hour Location: Remote Role Responsibilities Review AI-generated product specifications...Remote jobContract workSummer work$60 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Code Plan Reviewer (Plans Examiner) — Vulcan Type: Contract Compensation: $45–$60/hour Location: Remote Role Responsibilities Develop evaluation tasks using real permit review work...Remote jobHourly payContract workFor contractorsSummer work$20 per hour
...Type: Contract Compensation: $15–$20/hour Location: Remote Commitment: 20 hours/week Role Responsibilities... ...Categorize issues and mark the exact span where they occur using our review tooling. Report on overall listener satisfaction and identify...Remote jobContract workPart timeSummer work$12 per hour
...Type: Contract Compensation: $13/hour Location: Remote Role Responsibilities Source documents: find a publicly accessible... ...dimensions, and flags for tables, formulas, and handwriting. Review a colleague's work: every task is reviewed end to end by a...Remote jobContract workSummer work$70 per hour
...Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate... ...compliance, and overall quality. Review content involving misinformation, political... ...field. ~ Excellent written English , critical thinking, and analytical reasoning...Remote jobContract workSummer work$65k - $72k
...The Document Control Specialist, HR, will build the structure... ...& Records Management (approx.. 70%): Design and implement a master... ...version control and audit trails. Review and edit correspondence for... ...Primary Work Location: This is a remote position; ideal applicants will...Remote workLocal areaWork visa$70k - $80k
...Magnolia Tax Services is hiring a Senior Tax Reviewer to review business and individual returns... ...anchor for our preparer team. This is a fully remote, full-time role open to candidates living... ...welcome Benefits - Base salary: $70,000 to $80,000, based on experience and...Remote workFull timeLive in- ...for Medicare & Medicaid Services (CMS) reviewing the prior authorization (PA) and step therapy... ...fixed deadlines Strong analytical, critical thinking, problem-solving, and decision... ...Working Conditions: US-based fully remote/work-from-home position PRN position...Remote workContract workTemporary workReliefSeasonal workWork at officeWork from home
$70 per hour
...Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate and utilize Windows... ..., reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobContract workSummer work- ...Behavioral Health Utilization Management Reviewer, you'll play a vital role in ensuring... ...training/onboarding – this position is fully remote. Candidate must hold professional license... .... Strong clinical assessment and critical thinking skills. Excellent written and...Remote workHourly pay
$30 per hour
...KLDiscovery Document Reviewer KLDiscovery, a leading global provider... ...U.S. attorneys for ongoing remote Document Review projects.... ...project needs and client approval. Fully remote work-from-home... ...Excellent attention to detail, critical thinking, and ability to follow...Remote workTemporary workWork from homeHome office$70 per hour
...Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate the usability and... ...support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobContract workSummer work$47.84k - $58.24k
...Description JOB SUMMARY: This is a fully remote position. Responsible for examining and analyzing documents... ...relevance in legal or regulatory contexts. This role is critical in litigation, compliance, and operational review processes, helping the firm identify key evidence...Remote workFull timeWork experience placementH1bWork at office$70 per hour
...Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Utilize Excel for... ...support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobContract workSummer work$77 per hour
...Position: DevSecOps Engineer Type: Contract Compensation: $70–$77/hour Location: Remote Role Responsibilities Maintain AWS infrastructure as code... ...engineering tools (e.g., GitHub Copilot , Claude ) to author and review infrastructure. Qualifications Must-Have Hands-on AWS...Remote workContract workSummer work$70 per hour
...Search Expert Type: Contract Compensation: $40–$70/hour Location: Remote Role Responsibilities Evaluate the accuracy and... ...to strengthen reasoning and rigor in model outputs . Review complex content for alignment with domain principles and methodologies...Remote jobContract workSummer work$70 per hour
...Position: Electrical Engineer, Power Stations Type: Contract Compensation: $70/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities Review tasks on power station electrical systems, including circuit and control design ,...Remote jobContract workFor contractorsSummer workImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Critical Reviewer - Fully Remote | Upto $70/hr. Be the first to apply!
- senior devops engineer remote New York, NY
- hr manager remote New York, NY
- remote french New York, NY
- javascript developer remote New York, NY
- clinical research remote New York, NY
- remote support technician New York, NY
- remote qa New York, NY
- technical recruiter - remote New York, NY
- remote salesforce developer New York, NY
- remote senior project manager New York, NY



