Critical Reviewer - Fully Remote | Upto $70/hr
$70 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist Expert
Type: Contract
Compensation: $70/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated responses to strengthen reasoning and rigor in model outputs .
- Provide structured written feedback to improve training data quality and downstream performance.
- Develop clear, precise, and well-evidenced written rationales beyond surface-level observations.
- Apply strict attention to detail and accurate application of structured evaluation guidelines.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- Bachelor's degree from a top-500 globally ranked university preferred.
- Strong analytical and written communication skills.
- Ability to work independently and follow detailed task guidelines.
- Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning.
- Ability to write clear, precise, and well-evidenced written rationales.
- Consistent and honest judgment, including the ability to give critical assessments.
- Strict attention to detail and accurate application of structured evaluation guidelines.
- Ability to work entirely without AI writing tools .
- Native English fluency required.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the Critical Reviewer - Fully Remote | Upto $70/hr in New York, NY vacancy
$70 per hour
...Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation: $50–$70/hour Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for quality and correctness....Remote jobContract workSummer workFlexible hours$40 per hour
...and Jack Dorsey . Position: Document Review Expert Type: Contract Compensation: $35–$40/hour Location: Remote Commitment: 30–40+ hours/week Role... ...detailed task guidelines. Strong critical reading skills with the ability to identify...Remote jobContract workSummer workImmediate startMercor
New York, NY29 days ago$90 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: STEM QA Reviewer — Electrical Engineering Type: Contract Compensation: $90/hour Location: Remote Duration: 3-week engagement (6/5–6/25) Role Responsibilities Evaluate the...Remote workHourly payWeekly payContract workPart timeFor contractorsSummer workMercor
New York, NY2 days ago$120 per hour
...: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against... ...or support, reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobContract workSummer workWork at office$120 per hour
...Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... ...structured written feedback to improve AI-generated content. Review documents, spreadsheets, and slide decks for accuracy and rigor....Remote jobContract workSummer workWork at office$50 per hour
...Type: Contract Compensation: $50/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities Evaluate... ...to strengthen reasoning and rigor in model outputs . Review complex scientific documents for alignment with domain principles...Remote jobContract workPart timeSummer work$70 per hour
...Search Expert Type: Contract Compensation: $40–$70/hour Location: Remote Role Responsibilities Evaluate the accuracy and... ...to strengthen reasoning and rigor in model outputs . Review complex content for alignment with domain principles and methodologies...Remote workContract workSummer workMercor
New York, NY7 days ago$70 per hour
...safety, factual accuracy, policy compliance, and overall quality. Review content involving misinformation, political persuasion, self-... ..., security, or a related field. Excellent written English, critical thinking, and analytical reasoning skills. Ability to consistently...Remote jobWorldwide$70 per hour
...Education Expert Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct higher education... ...curriculum and program design, faculty senate or accreditation review, and budget or enrollment planning. Build education...Remote workContract workSummer workMercor
San Francisco, CA2 days ago$70 per hour
...Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week... ...code in Docker . Preferred Publications in peer-reviewed journals. Prior scientific software or research engineering...Remote workContract workSummer workImmediate startMercor
San Francisco, CA2 days ago$70 per hour
..., MS, PhD's) Type: Contract Compensation: $50–$70/hour Location: Remote Duration: 1–2 month minimum, extension likely Commitment... ..., reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote workContract workSummer workImmediate startMercor
New York, NY6 days ago$70 per hour
...Position: Supply Chain ExpertType:ContractCompensation:$60-$70/hourLocation:Remote Role Responsibilities Construct enterprise supply chain scenarios... ...of how F500 sourcing, procurement, and vendor contract review actually work. Preferred Prior rubric, supply chain...Remote jobContract workSummer work$70 per hour
...Banking Expert Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct enterprise retail... ...decisions, and complex regulatory examination or compliance review cycles. Build tasks across F500 consumer lending (...Remote jobContract workSummer workMercor
San Francisco, CA16 days ago- ...hybrid role that is predominantly remote, with limited on-site... ...customer retention rate, with over 70% of our clients having been with... ...a communicator. You can think critically, identify opportunities, and... ...goes up, so does our pay.Fully remote roles, you can work from...Remote workLive outCurrently hiring
DataServ Missouri
Saint Louis, MO2 days ago $70 per hour
...Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Corporate Strategy ExpertType:ContractCompensation:$60-$70/hourLocation:Remote Role Responsibilities Construct enterprise strategy scenarios for multi-year corporate planning and board-level decision-...Remote jobSummer work$70 per hour
...-Phase Insights Type: Contract Compensation: $70/hour Location: Remote Duration: Approximately 20 minutes Role Responsibilities... ..., reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobContract workSummer work$150 per hour
...Compensation: $100–$150/hour Location: Remote Role Responsibilities Lead... ...management operations, including concurrent review, retrospective review, discharge... ...attention to detail with the ability to critically evaluate clinical documentation and AI-...Remote jobContract workSummer workNight shiftMercor
San Francisco, CA28 days ago$70 - $80 per hour
...Elsevier Clinical Content Reviewer, Specialty Specific (... ...Term Contract) Remote (North America) About... ...content. You will play a critical role in reviewing content... ...autonomously in a fully remote environment, must... ...role will pay between $70-$80 USD / hour depending...Remote workPart timeFixed term contractReliefWork at officeWork from homeFlexible hoursOsmosis
United States3 days ago$70 per hour
...Position: Senior Civil Legal Paralegal / Accredited Representative Type: Contract Compensation: $70/hour Location: Remote Role Responsibilities Review AI-generated legal guidance for accuracy and relevance in civil legal services. Evaluate...Remote jobContract workSummer work$70 per hour
...Education Expert Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct higher education... ...for curriculum and program design, faculty senate reviews, and institutional planning cycles. Build education tasks...Remote jobContract workSummer work$70 per hour
...Marketing Expert Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct enterprise sales... ...plus understanding of F500 budgets, procurement, and legal review. Preferred ~ Prior rubric, sales-enablement...Remote jobContract workSummer work$70 per hour
...Detection Experts Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct enterprise fraud... ..., reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobContract workSummer work$100 per hour
...Experts Type: Contract Compensation: $70-$100/hour Location: Remote Commitment: 10-20+ hours/week Role... ...professional experience producing and reviewing office documents. Strong in Excel/... ...support where document quality is mission-critical. Familiarity with comparing or QA‑...Remote jobContract workSummer workWork at officeImmediate start$70 per hour
...Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week... ...code in Docker . Preferred Publications in peer-reviewed journals. Prior scientific software or research engineering...Remote jobContract workSummer workImmediate start$70 per hour
...Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week... ...GitHub and Docker . Preferred Publications in peer-reviewed journals. Prior scientific software or research engineering...Remote jobContract workSummer workImmediate start$70 per hour
...Data Projects Type: Contract Compensation: $45–$70/hour Location: Remote Role Responsibilities Act as a day-to-day point of... ...the program expands. Participate in weekly business reviews. Organize notes and action items. Lead calls when necessary...Remote jobContract workSummer workFlexible hours$70 per hour
...Chain Expert Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct enterprise supply chain... ...of F500 sourcing, procurement, and vendor contract review. Preferred ~ Prior rubric, supply chain training curriculum...Remote jobContract workSummer work$70 per hour
...Analytics Experts Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct enterprise data... ..., reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobContract workSummer work$70 per hour
...Data for Autonomous Systems annotation Type: Contract Compensation: $50–$70/hour Location: Remote Commitment: 30–40 hours/week Role Responsibilities Review real-world data from deployed networks, including logs, configs, telemetry, and event...Remote jobContract workSummer work$70 per hour
...Analytics Experts Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct enterprise data... ..., reach out to: ****@*****.*** PS: Our team reviews applications daily. Please complete your AI interview and...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Critical Reviewer - Fully Remote | Upto $70/hr. Be the first to apply!
Related searches
- software engineering manager remote New York, NY
- system engineer remote New York, NY
- remote technical project manager New York, NY
- remote recruitment consultant New York, NY
- remote property manager New York, NY
- remote reviewer New York, NY
- remote insurance agent New York, NY
- remote no experience New York, NY
- remote life underwriter New York, NY
- remote medical coding supervisor New York, NY