Psychometrics Expert - Fully Remote | Upto $63/hr
$63 per hourMercor
San Francisco, CA
- Remote job
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Applied Psychology Benchmark Specialist
Type: Contract
Compensation: $50–$63/hour
Location: Remote
Commitment: 10+ hours/week
Role Responsibilities
- Author original psychology questions that test deep conceptual understanding, not surface-level recall.
- Ensure questions are unambiguous, self-contained, and precisely defined with all necessary information in the problem statement.
- Rate each question's difficulty as Medium, Hard, or Expert to guide AI model training.
- Provide one correct answer and nine plausible but subtly incorrect alternatives to challenge expert-level solvers.
- Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format.
- Supply 1–5 academic references per question from reputable sources like peer-reviewed journals and university repositories.
- For verification tasks, flag issues with clarity, completeness, precision, or solvability and justify any edits made.
Qualifications
Must-Have
- PhD , PsyD , or doctoral candidate in Psychology or a closely related field.
- Master's degree considered for candidates with exceptional depth in a specific subdomain.
- Strong command of graduate-level psychological theory, research methodology, and empirical literature.
- Excellent written English and ability to express complex ideas clearly and concisely.
Preferred
- Clinical licensure or research publications in psychology .
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the Psychometrics Expert - Fully Remote | Upto $63/hr in San Francisco, CA vacancy
$63 per hour
...Benchmark Specialist Type: Contract Compensation: $50–$63/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities... .... Rate each question's difficulty as Medium, Hard, or Expert. Provide 1 correct answer and 9 plausible but subtly...Remote jobContract workSummer work$63 per hour
...Benchmark Specialist Type: Contract Compensation: $50–$63/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities... .... Rate each question's difficulty as Medium, Hard, or Expert to guide AI model training. Provide one correct answer...Remote jobContract workSummer work$110 per hour
We are seeking U.S.-based experts with direct underwriting experience in the Excess & Specialty Insurance market, particularly underwriting SME/commercial accounts . Engagement Details Initial pilot: 4 experts Duration: 1 week Commitment: ~20 hours per expert Potential...Remote job$120 per hour
About the role We are hiring expert Evaluators in Customer success / support operations to review and assess AI-generated work products... ...apply deep subject‑matter expertise to grade outputs. This is a remote, hourly engagement. Requirements (must have) 5+ years of relevant...Remote jobHourly payWork at office$180 per hour
...reasoning data. We're hiring Internal Medicine experts to design clinical scenarios, evaluate... ...medical license Rates $130-$300/hr payable , set per seniority tier (early-career... ...rate is confirmed in your offer. Engagement Remote, 100% asynchronous 20 hrs/wk default (can...Remote jobWeekly payWork at office$12 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: PDF Annotation & Transcription Experts – Telugu Type: Contract Compensation: $13/hour Location: Remote Role Responsibilities Source documents by finding publicly accessible Telugu PDFs...Remote jobContract workSummer workMercor
New York, NY17 days ago$63 per hour
...Benefits Insights Type: Contract Compensation: $63 total Location: Remote Duration: Approximately 25 minutes Role... ...title such as CHRO or Chief People Officer, VP or Head of HR, Benefits, or Total Rewards, Director of HR, Benefits, or...Remote jobContract workSummer work$77 per hour
...Type: Contract Compensation: $61–$77/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities... ...information. Rate each question's difficulty: Medium, Hard, or Expert. Provide 1 correct answer and 9 plausible incorrect alternatives...Remote jobContract workSummer workMercor
New York, NYa month ago$75 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: STEM Expert (Physics, Chemistry, Mathematics, Biology) Type: Contract Compensation: $75/hour Location: Remote Role Responsibilities Evaluate complex problems in physics , chemistry...Remote jobContract workSummer workInternshipMercor
New York, NY8 days ago$120 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Domain Expert – Legal (Lexis+ Research) Type: Contract Compensation: $76–$120/hour Location: Remote Role Responsibilities Confirm every case, statute, and regulation is still...Remote jobContract workSummer work$70 per hour
...Summers , and Jack Dorsey . Position: Application Users - Linux Ubuntu 24.04 Expert - Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate the usability and functionality of Linux Ubuntu...Remote jobContract workSummer work$60 per hour
...Position: Product Reviewer – AI Web Application Specifications Type: Contract Compensation: $30–$60/hour Location: Remote Role Responsibilities Review AI-generated product specifications for web applications. Evaluate if product requests are...Remote jobContract workSummer work$90 per hour
...Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities... ...Work as a team by sharing insights with researchers and fellow experts to continually improve the benchmark. Qualifications Must...Remote jobContract workSummer work$60 per hour
...Type: Contract Compensation: $60/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities Author... ...educational content . Collaborate with subject matter experts to ensure task relevance and accuracy. Work independently...Remote jobContract workPart timeSummer work$150 per hour
...Position: Clinical Documentation Integrity (CDI) Specialist Type: Contract Compensation: $50–$150/hour Location: Remote Role Responsibilities Review AI-agent attempts at realistic CDI/coding tasks . Judge whether each disposition is correct...Remote jobContract workSummer work$140 per hour
...Larry Summers , and Jack Dorsey . Position: Healthcare Survey Research & Pharma Insights Expert Type: Contract Compensation: $140/hour Location: Remote Role Responsibilities Design, review, and refine physician and patient survey...Remote jobContract workSummer work$54 per hour
...D'Angelo , Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - English (US/UK/Australia) Type: Contract Compensation: $23–$54/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities...Remote jobContract workSummer workImmediate start$100 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal Domain Expert — AI Training & Evaluation Type: Contract Compensation: $60–$100/hour Location: Hybrid, Bay Area, California...Remote jobContract workSummer work$90 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product Management Expert Type: Contract Compensation: $80–$90/hour Location: Remote Role Responsibilities Construct enterprise product scenarios for multi-quarter roadmap...Remote jobContract workSummer work$120 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Domain Expert – Banking (Oracle FLEXCUBE Research) Type: Contract Compensation: $75–$120/hour Location: Remote Role Responsibilities Confirm the customer/contract position reflects...Remote jobContract workSummer work$160 per hour
...Jack Dorsey . Position: Event / Hospitality Professionals Type: Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-specific documents to ensure quality, accuracy, and relevance. Provide...Remote jobContract workSummer work$120 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal Expert — Immigration (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~6 hours Role Responsibilities Read a synthetic legal matter...Remote jobContract workSummer work$60 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Expert Project Manager Type: Contract Compensation: $50–$60/hour Location: Remote Role Responsibilities Track project and annotator performance using Google Sheets...Remote jobContract workSummer work$19 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Telugu Type: Contract Compensation: $11–$19/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities...Remote jobContract workSummer workImmediate start$140 per hour
...Summers , and Jack Dorsey . Position: Mechanical, Electrical & Plumbing (MEP) Expert — Data Centers Type: Contract Compensation: $100–$140/hour Location: Remote Commitment: 5–10 hours/week Role Responsibilities Review complex engineering...Remote jobContract workSummer workImmediate start$19 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Bengali Type: Contract Compensation: $11–$19/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities...Remote jobContract workSummer workImmediate start$120 per hour
...D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal Expert — Disputes & International (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~24 hours Role Responsibilities Evaluate AI-generated...Remote jobContract workSummer work$160 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Analyst / Insights Experts Type: Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-specific documents for quality, accuracy...Remote jobContract workSummer workFlexible hours$190 per hour
...: Contract Compensation: $170–$190/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities Review... ...teams can act on to improve AI systems . Contribute expert input on annotation guidelines, documentation standards, and edge...Remote jobContract workWork experience placementSummer work$100 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Corporate Treasury Expert Type: Contract Compensation: $85–$100/hour Location: Remote Role Responsibilities Build rolling 13-week direct cash forecasts with receipts, disbursements...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Psychometrics Expert - Fully Remote | Upto $63/hr. Be the first to apply!
Related searches
- guest service support expert San Francisco, CA
- fulfillment expert San Francisco, CA
- subject matter expert San Francisco, CA
- technology expert San Francisco, CA
- remote reviewer San Francisco, CA
- senior php developer remote San Francisco, CA
- remote sales consultant San Francisco, CA
- medicare sales agent remote San Francisco, CA
- web design internship remote San Francisco, CA
- remote insurance verification jobs San Francisco, CA