Psychometrics Expert - Fully Remote | Upto $63/hr
$63 per hourMercor
San Francisco, CA
- Remote job
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Applied Psychology Benchmark Specialist
Type: Contract
Compensation: $50–$63/hour
Location: Remote
Commitment: 10+ hours/week
Role Responsibilities
- Author original psychology questions that test deep conceptual understanding, not surface-level recall.
- Ensure questions are unambiguous, self-contained, and precisely defined with all necessary information in the problem statement.
- Rate each question's difficulty as Medium, Hard, or Expert to guide AI model training.
- Provide one correct answer and nine plausible but subtly incorrect alternatives to challenge expert-level solvers.
- Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format.
- Supply 1–5 academic references per question from reputable sources like peer-reviewed journals and university repositories.
- For verification tasks, flag issues with clarity, completeness, precision, or solvability and justify any edits made.
Qualifications
Must-Have
- PhD , PsyD , or doctoral candidate in Psychology or a closely related field.
- Master's degree considered for candidates with exceptional depth in a specific subdomain.
- Strong command of graduate-level psychological theory, research methodology, and empirical literature.
- Excellent written English and ability to express complex ideas clearly and concisely.
Preferred
- Clinical licensure or research publications in psychology .
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Psychometrics Expert - Fully Remote | Upto $63/hr in San Francisco, CA vacancy
$63 per hour
...Benchmark Specialist Type: Contract Compensation: $50–$63/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities... ...(intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above). Provide 1 correct answer and...Remote jobContract workSummer work$110 per hour
...We are seeking U.S.-based experts with direct underwriting experience in the Excess & Specialty Insurance market, particularly underwriting SME/commercial accounts . Engagement Details Initial pilot: 4 experts Duration: 1 week Commitment: ~20 hours per...Remote workObsidian
United States21 hours ago$120 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Domain Expert – Legal (Lexis+ Research) Type: Contract Compensation: $76–$120/hour Location: Remote Role Responsibilities Confirm every case, statute, and regulation is still...Remote workContract workSummer workMercor
San Francisco, CA9 days ago$120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Domain Expert - Legal (Lexis+ Research) Type: Contract Compensation: $76-$120/hour Location: Remote Role Responsibilities Confirm every case, statute, and regulation is still good law...Remote jobContract workSummer work$60 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Expert Project Manager Type: Contract Compensation: $50–$60/hour Location: Remote Role Responsibilities Track project and annotator performance using Google Sheets...Remote workContract workSummer workMercor
New York, NY8 days ago$150 per hour
...Position: Clinical Documentation Integrity (CDI) Specialist Type: Contract Compensation: $50–$150/hour Location: Remote Role Responsibilities Review AI-agent attempts at realistic CDI/coding tasks . Judge whether each disposition is correct...Remote workContract workSummer workMercor
New York, NY8 days ago$54 per hour
...D'Angelo , Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - English (US/UK/Australia) Type: Contract Compensation: $23–$54/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities...Remote workContract workSummer workImmediate startMercor
New York, NY8 days ago$90 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Chess Expert (1800+ ELO) — Game Reconstruction & Transcript Correction Type: Contract Compensation: $90/hour Location: Remote Role Responsibilities Evaluate and correct speech-to-text...Remote workContract workSummer workFlexible hoursMercor
San Francisco, CA4 days ago$77 per hour
...Type: Contract Compensation: $61–$77/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities... ...statement. Rate each question's difficulty as Medium, Hard, or Expert, providing 1 correct answer and 9 plausible alternatives to challenge...Remote workContract workSummer workMercor
New York, NY4 days ago$120 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Domain Expert – Banking (Oracle FLEXCUBE Research) Type: Contract Compensation: $75–$120/hour Location: Remote Role Responsibilities Confirm the customer/contract position reflects...Remote workContract workSummer workMercor
New York, NY4 days ago$90 per hour
...Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities... ...Work as a team by sharing insights with researchers and fellow experts to continually improve the benchmark. Qualifications Must...Remote workContract workSummer workMercor
San Francisco, CA4 days ago$110 per hour
...: Contract Compensation: $70–$110/hour Location: Remote Commitment: 40 hours/week Role Responsibilities Guide... ...AI workloads . Collaborate with other subject matter experts to ensure consistency and accuracy in training data. Qualifications...Remote workContract workSummer workWeekday workMercor
New York, NY8 days ago$100 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Corporate Treasury Expert Type: Contract Compensation: $85–$100/hour Location: Remote Role Responsibilities Build rolling 13-week direct cash forecasts with receipts, disbursements...Remote workContract workSummer workMercor
New York, NY8 days ago$150 per hour
...Utilisation Management / Case Management leader (RN/Physician-advisor) Type: Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Lead utilisation management and case management operations, including concurrent review,...Remote workContract workSummer workNight shiftMercor
New York, NY4 days ago$120 per hour
About the role We are hiring expert Evaluators in Customer success / support operations to review and assess AI-generated work products... ...apply deep subject‑matter expertise to grade outputs. This is a remote, hourly engagement. Requirements (must have) 5+ years of relevant...Remote jobHourly payWork at office$70 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Higher Education Expert Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct higher education scenarios for curriculum and program...Remote workContract workSummer workMercor
New York, NY2 days ago$119 per hour
...Type: Contract Compensation: $94–$119/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities... ...included. Rate each question's difficulty as Medium, Hard, or Expert to challenge expert-level solvers. Provide one correct answer...Remote workContract workSummer workMercor
New York, NY8 days ago$180 per hour
...reasoning data. We're hiring Internal Medicine experts to design clinical scenarios, evaluate... ...medical license Rates $130-$300/hr payable , set per seniority tier (early-career... ...rate is confirmed in your offer. Engagement Remote, 100% asynchronous 20 hrs/wk default (can...Remote jobWeekly payWork at office$50 per hour
...Jack Dorsey . Position: Shopify Storefront Agent Evaluator Type: Contract Compensation: $40–$50/hour Location: Remote Commitment: up to 5 hours/week Role Responsibilities Evaluate the Storefront Agent by simulating real shopper...Remote workContract workSummer workMercor
New York, NY8 days ago$110 per hour
.... Position: Mathematics Research Collaborator (Part-time) Type: Contract Compensation: $80–$110/hour Location: Remote Commitment: Up to 20 hours/week Role Responsibilities Review and evaluate research papers in mathematics for correctness...Remote workContract workPart timeSummer workImmediate startMercor
San Francisco, CA9 days ago$84 per hour
...D'Angelo , Larry Summers , and Jack Dorsey . Position: Atomic Layer Deposition (ALD) Experts Type: Contract Compensation: $84/hour Location: Remote Commitment: 10–40 hours/week Role Responsibilities Contribute domain expertise across...Remote workContract workSummer workMercor
San Francisco, CA9 days ago$120 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Equity Research Expert Type: Contract Compensation: $120/hour Location: Remote Duration: Minimum four weeks Commitment: 10+ hours/week Role Responsibilities...Remote workHourly payContract workFor contractorsSummer workMercor
New York, NY8 days ago$60 per hour
...Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Insurance ExpertsType:ContractCompensation:$50-$60/hourLocation:Remote Role Responsibilities Construct enterprise insurance scenarios for complex commercial underwriting, multi-stakeholder claims...Remote jobSummer work$145 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications) Type: Contract Compensation: $110–$145/hour Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-...Remote workContract workSummer workMercor
San Francisco, CA7 days ago$142 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Preclinical R&D Expert – ADC & Bispecifics Type: Contract Compensation: $85–$142/hour Location: Remote Role Responsibilities Review technical materials and real-world R&D data...Remote workHourly payContract workFor contractorsSummer workMercor
New York, NY7 days ago$84 per hour
...Type: Contract Compensation: $84/hour Location: Remote Role Responsibilities Lead clinical documentation integrity... ...-generated outputs. ~ Comfortable working independently in a fully remote environment. Preferred CCDS (Certified Clinical...Remote jobContract workSummer workMercor
New York, NY12 days ago$120 per hour
...Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic...Remote jobContract workSummer workWork at officeMercor
New York, NY14 days ago$63 per hour
...Benefits Insights Type: Contract Compensation: $63/hour Location: Remote Duration: Approximately 25 minutes Role Responsibilities... ...title such as CHRO or Chief People Officer, VP or Head of HR, Benefits, or Total Rewards, Director of HR, Benefits, or...Remote jobContract workSummer work$77 per hour
...Type: Contract Compensation: $61–$77/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities... ...information. Rate each question's difficulty: Medium, Hard, or Expert. Provide 1 correct answer and 9 plausible incorrect alternatives...Remote jobContract workSummer workMercor
New York, NY8 days ago$80 per hour
...Type: Contract Compensation: $80/hour Location: Remote Role Responsibilities Lead end-to-end patient access operations... ...skills. ~ Comfortable working independently in a fully remote environment. Preferred NAHAM Certified Healthcare...Remote jobContract workSummer workMercor
San Francisco, CA5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Psychometrics Expert - Fully Remote | Upto $63/hr. Be the first to apply!
Related searches
- subject matter expert San Francisco, CA
- fulfillment expert San Francisco, CA
- guest service support expert San Francisco, CA
- technology expert San Francisco, CA
- software engineering manager remote San Francisco, CA
- system engineer remote San Francisco, CA
- remote technical project manager San Francisco, CA
- remote recruitment consultant San Francisco, CA
- remote property manager San Francisco, CA
- remote reviewer San Francisco, CA