Psychometrics Expert - Fully Remote | Upto $63/hr
$63 per hourMercor
San Francisco, CA
- Remote job
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Applied Psychology Benchmark Specialist
Type: Contract
Compensation: $50–$63/hour
Location: Remote
Commitment: 10+ hours/week
Role Responsibilities
- Author original psychology questions that test deep conceptual understanding, not surface-level recall.
- Ensure questions are unambiguous, self-contained, and precisely defined with all necessary information in the problem statement.
- Rate each question's difficulty as Medium, Hard, or Expert to guide AI model training.
- Provide one correct answer and nine plausible but subtly incorrect alternatives to challenge expert-level solvers.
- Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format.
- Supply 1–5 academic references per question from reputable sources like peer-reviewed journals and university repositories.
- For verification tasks, flag issues with clarity, completeness, precision, or solvability and justify any edits made.
Qualifications
Must-Have
- PhD , PsyD , or doctoral candidate in Psychology or a closely related field.
- Master's degree considered for candidates with exceptional depth in a specific subdomain.
- Strong command of graduate-level psychological theory, research methodology, and empirical literature.
- Excellent written English and ability to express complex ideas clearly and concisely.
Preferred
- Clinical licensure or research publications in psychology .
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 9 days ago
Similar jobs that could be interesting for youBased on the Psychometrics Expert - Fully Remote | Upto $63/hr in San Francisco, CA vacancy
$63 per hour
...Benchmark Specialist Type: Contract Compensation: $50–$63/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities... .... Rate each question's difficulty as Medium, Hard, or Expert. Provide 1 correct answer and 9 plausible but subtly...Remote jobContract workSummer work$63 per hour
...Benchmark Specialist Type: Contract Compensation: $50–$63/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities... .... Rate each question's difficulty as Medium, Hard, or Expert to guide AI model training. Provide one correct answer...Remote jobContract workSummer work$63 per hour
...Benefits Insights Type: Contract Compensation: $63 total Location: Remote Duration: Approximately 25 minutes Role... ...title such as CHRO or Chief People Officer, VP or Head of HR, Benefits, or Total Rewards, Director of HR, Benefits, or...Remote workContract workSummer workMercor
New York, NYa month ago$44 per hour
# Music Audio Expert - Fully Remote | Upto $44/hrUnited States2 hours agoID 5413158Price on request## DetailsEmployment type: ContractRemote: YesCompany: mercor## DescriptionAbout the job Mercor connects elite creative and technical talent with leading AI research labs...Remote jobContract workSummer workImmediate start$90 per hour
..., and Jack Dorsey . Position: Kubernetes Task Auditor Type: Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate the quality and correctness of Kubernetes tasks for training and evaluating AI models. Assess...Remote jobContract workSummer workMercor
San Francisco, CA8 days ago$120 per hour
...Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic...Remote jobContract workSummer workWork at officeMercor
New York, NY11 days ago$75 per hour
...Specialist Type: Contract Compensation: $60-$75/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities Author original... ...Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above). Provide 1 correct answer and 9 plausible...Remote jobContract workSummer work$140 per hour
...Summers , and Jack Dorsey . Position: Mechanical, Electrical & Plumbing (MEP) Expert — Data Centers Type: Contract Compensation: $100–$140/hour Location: Remote Commitment: 5–10 hours/week Role Responsibilities Review complex engineering...Remote workContract workSummer workImmediate startMercor
New York, NY7 days ago$50 per hour
...Jack Dorsey . Position: Shopify Storefront Agent Evaluator Type: Contract Compensation: $40–$50/hour Location: Remote Commitment: up to 5 hours/week Role Responsibilities Evaluate the Storefront Agent by simulating real shopper...Remote workContract workSummer workMercor
New York, NYa month ago$100 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Accounting & Audit Domain Expert Type: Contract Compensation: $60–$100/hour Location: Hybrid, Bay Area, California Commitment: 40 hours/week...Remote workHourly payWeekly payContract workFor contractorsSummer workMercor
New York, NYa month ago$100 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Office-Suite Experts Type: Contract Compensation: $70-$100/hour Location: Remote Commitment: 10-20+ hours/week Role Responsibilities Open and inspect downloaded office artifacts...Remote jobContract workSummer workWork at officeImmediate start$100 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Preclinical R&D Expert - In-house Drug Development Type: Contract Compensation: $60-$100/hour Location: Remote Commitment: 10 hours/week Role Responsibilities Review technical materials and real-...Remote jobContract workSummer work$150 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Local Political Expert Elections Forecasting & Political Risk Type: Contract Compensation: $150-$250/hour Location: Remote Role Responsibilities Author point-in-time political reports and forecasts from a...Remote jobOdd jobContract workSummer workLocal area$142 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Preclinical R&D Expert – ADC & Bispecifics Type: Contract Compensation: $85–$142/hour Location: Remote Role Responsibilities Review technical materials and real-world R&D data...Remote workHourly payContract workFor contractorsSummer workMercor
New York, NYa month ago$70 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Fraud Detection Experts Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct enterprise fraud scenarios for large-scale transaction...Remote jobContract workSummer workMercor
New York, NY3 days ago$33 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: PDF Annotation & Transcription Experts - Japanese Type: Contract Compensation: $34/hour Location: Remote Role Responsibilities Source documents by finding publicly accessible Japanese PDFs with...Remote jobContract workSummer work$120 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Domain Expert – Legal (Lexis+ Research) Type: Contract Compensation: $76–$120/hour Location: Remote Role Responsibilities Confirm every case, statute, and regulation is still...Remote jobContract workSummer work$70 per hour
...Summers , and Jack Dorsey . Position: Application Users - Linux Ubuntu 24.04 Expert - Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate the usability and functionality of Linux Ubuntu...Remote jobContract workSummer work$54 per hour
...D'Angelo , Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - English (US/UK/Australia) Type: Contract Compensation: $23–$54/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities...Remote jobContract workSummer workImmediate start$100 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Investor Relations Expert Type: Contract Compensation: $100/hour Location: Remote Role Responsibilities Draft earnings releases, prepared remarks, and Q&A briefings for...Remote jobContract workSummer work$140 per hour
...Larry Summers , and Jack Dorsey . Position: Healthcare Survey Research & Pharma Insights Expert Type: Contract Compensation: $140/hour Location: Remote Role Responsibilities Design, review, and refine physician and patient survey...Remote jobContract workSummer work$60 per hour
...Type: Contract Compensation: $60/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities Author... ...educational content . Collaborate with subject matter experts to ensure task relevance and accuracy. Work independently...Remote jobContract workPart timeSummer work$150 per hour
...Position: Clinical Documentation Integrity (CDI) Specialist Type: Contract Compensation: $50–$150/hour Location: Remote Role Responsibilities Review AI-agent attempts at realistic CDI/coding tasks . Judge whether each disposition is correct...Remote jobContract workSummer work$90 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Chess Expert (1800+ ELO) — Game Reconstruction & Transcript Correction Type: Contract Compensation: $90/hour Location: Remote Role Responsibilities Evaluate and correct speech-to-text...Remote jobContract workSummer workFlexible hours$60 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Expert Project Manager Type: Contract Compensation: $50–$60/hour Location: Remote Role Responsibilities Track project and annotator performance using Google Sheets...Remote jobContract workSummer work$120 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Legal Expert — Regulatory, Privacy & Healthcare (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~30 hours Role Responsibilities Evaluate AI...Remote jobContract workSummer work$120 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal Expert — Immigration (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~6 hours Role Responsibilities Read a synthetic legal matter...Remote jobContract workSummer work$100 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal Domain Expert — AI Training & Evaluation Type: Contract Compensation: $60–$100/hour Location: Hybrid, Bay Area, California...Remote jobContract workSummer work$20 per hour
...and Jack Dorsey . Position: Video Evaluation Generalist Type: Contract Compensation: $15–$20/hour Location: Remote Commitment: 20 hours/week Role Responsibilities Evaluate paired video outputs by comparing two short video clips against...Remote jobContract workSummer work$160 per hour
...Dorsey . Position: Engineering / Platform Professionals Type: Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-specific documents to ensure quality, accuracy, and relevance. Provide structured...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Psychometrics Expert - Fully Remote | Upto $63/hr. Be the first to apply!
Related searches
- technology expert San Francisco, CA
- subject matter expert San Francisco, CA
- guest service support expert San Francisco, CA
- fulfillment expert San Francisco, CA
- graphic design remote San Francisco, CA
- remote document review San Francisco, CA
- remote recruiter San Francisco, CA
- remote infrastructure engineer San Francisco, CA
- genetic counselor remote San Francisco, CA
- remote video game San Francisco, CA