Psychometrics Expert - Fully Remote | Upto $63/hr
$63 per hourMercor
San Francisco, CA
- Remote job
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Applied Psychology Benchmark Specialist
Type: Contract
Compensation: $50–$63/hour
Location: Remote
Commitment: 10+ hours/week
Role Responsibilities
- Author original psychology questions that test deep conceptual understanding, not surface-level recall.
- Ensure questions are unambiguous, self-contained, and precisely defined with all necessary information in the problem statement.
- Rate each question's difficulty as Medium, Hard, or Expert to guide AI model training.
- Provide one correct answer and nine plausible but subtly incorrect alternatives to challenge expert-level solvers.
- Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format.
- Supply 1–5 academic references per question from reputable sources like peer-reviewed journals and university repositories.
- For verification tasks, flag issues with clarity, completeness, precision, or solvability and justify any edits made.
Qualifications
Must-Have
- PhD , PsyD , or doctoral candidate in Psychology or a closely related field.
- Master's degree considered for candidates with exceptional depth in a specific subdomain.
- Strong command of graduate-level psychological theory, research methodology, and empirical literature.
- Excellent written English and ability to express complex ideas clearly and concisely.
Preferred
- Clinical licensure or research publications in psychology .
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 27 days ago
Similar jobs that could be interesting for youBased on the Psychometrics Expert - Fully Remote | Upto $63/hr in San Francisco, CA vacancy
$63 per hour
...Psychology Benchmark Specialist Type: Contract Compensation: $50-$63/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities Author... ...(intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above). Provide 1 correct answer and 9...Remote jobContract workSummer work$63 per hour
...Benchmark Specialist Type: Contract Compensation: $50–$63/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities... .... Rate each question's difficulty as Medium, Hard, or Expert. Provide 1 correct answer and 9 plausible but subtly...Remote jobContract workSummer workMercor
New York, NY10 days ago$63 per hour
...& Pharmacy Benefits Insights Type: Contract Compensation: $63/hour Location: Remote Duration: Approximately 25 minutes Role Responsibilities Complete... ...title such as CHRO or Chief People Officer, VP or Head of HR, Benefits, or Total Rewards, Director of HR, Benefits, or...Remote jobContract workSummer work$120 per hour
...Jack Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic...Remote jobContract workSummer workWork at officeFlexible hoursMercor
New York, NY20 days ago$125 per hour
...Dorsey . Position: Biology & Biophysics Researchers (Part-time) Type: Contract Compensation: $125–$225/hour Location: Remote Commitment: 8–20 hours/week Role Responsibilities Author and review challenging biology and biophysics problems to train...Remote workContract workPart timeSummer workMercor Inc
United States4 days ago$120 per hour
...Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic...Remote workContract workSummer workWork at officeMercor Inc
United States4 days ago$70 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Chemistry Expert (PhD) — AI Safety Type: Contract Compensation: $65–$70/hour Location: Remote Commitment: 15–40 hours/week Role Responsibilities Write expert-level prompts across...Remote workContract workPart timeSummer workImmediate startMercor Inc
United States3 days ago$110 per hour
...We are seeking U.S.-based experts with direct underwriting experience in the Excess & Specialty Insurance market, particularly underwriting SME/commercial accounts . Engagement Details Initial pilot: 4 experts Duration: 1 week Commitment: ~20 hours per...Remote workMercor Inc
United States2 days ago$120 per hour
..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: CUDA Engineering Expert Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Analyze and optimize GPU kernels for performance, efficiency, and...Remote workContract workSummer workMercor Inc
United States3 days ago$70 per hour
...specialized chemistry topics. No prior AI/ML experience is required — we'll train you on the workflow. What you'll do Write expert‑level prompts across specialized chemistry topics. Evaluate and annotate model responses for scientific accuracy, helpfulness, and...Remote workPart timeImmediate startMercor Inc
United States4 days ago$100 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Particle & Nuclear Physics Expert Type: Contract Compensation: $70–$100/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities Design challenging computational problems...Remote workContract workSummer workMercor Inc
United States3 days ago$120 per hour
About the role We are hiring expert Evaluators in Customer success / support operations to review and assess AI-generated work... ...apply deep subject‑matter expertise to grade outputs. This is a remote, hourly engagement. Requirements (must have) 5+ years of relevant...Remote workHourly payWork at officeMercor
San Francisco, CA6 hours ago$120 per hour
...Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Domain Expert - Legal (Lexis+ Research) Type: Contract Compensation: $76-$120/hour Location: Remote Role Responsibilities Confirm every case, statute, and regulation is still good law for...Remote jobContract workSummer work$70 per hour
...Summers , and Jack Dorsey . Position: Application Users - Linux Ubuntu 24.04 Expert - Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate the usability and functionality of Linux Ubuntu...Remote jobContract workSummer workMercor
New York, NY5 days ago$110 per hour
...Summers, and Jack Dorsey. Position: Physics Research Collaborator (Part-time); Type: Contract. Compensation: $80-$110/hour. Location: Remote. Commitment: Up to 20 hours/week. Role Responsibilities Review and evaluate research papers in Physics for correctness, novelty,...Remote jobHourly payContract workPart timeFor contractorsSummer work$90 per hour
...Jack Dorsey . Position: Engineering Simulation Specialist Type: Contract Compensation: $60–$90/hour Location: Remote Role Responsibilities Develop simulations and specification sheets for AI models to design artifacts like controller gains...Remote jobContract workSummer workMercor
San Francisco, CA12 days ago$160 per hour
...Jack Dorsey . Position: Event / Hospitality Professionals Type: Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-specific documents to ensure quality, accuracy, and relevance. Provide...Remote workContract workSummer workMercor
San Francisco, CA21 days ago$50 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Electrical & Electronics Expert Type: Contract Compensation: $50/hour Location: Remote Commitment: 15-20 hours/week Role Responsibilities Evaluate the accuracy of AI models on visual document...Remote jobContract workPart timeSummer work$100 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Corporate Treasury Expert Type: Contract Compensation: $100/hour Location: Remote Role Responsibilities Build rolling 13-week direct cash forecasts with receipts,...Remote jobContract workSummer workMercor
San Francisco, CA10 days ago$160 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Analyst / Insights Experts Type: Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-specific documents for quality, accuracy...Remote jobContract workSummer workFlexible hoursMercor
San Francisco, CA13 days ago$50 per hour
..., Larry Summers , and Jack Dorsey . Position: Business Development Contractor Type: Contract Compensation: $35-$50/hour Location: Remote Commitment: Up to 40 hours/week Role Responsibilities Identify and contact prospective data partners to explore data-licensing opportunities...Remote jobContract workFor contractorsSummer work$55 per hour
...Windows - STEM Type: Contract Compensation: $45-$55/hour Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-... ...economic tasks and solutions. Collaborate with subject matter experts to ensure consistency, relevance, and coverage across datasets....Remote jobContract workSummer work$170 per hour
...and asynchronously to meet deadlines. Improve AI model performance through rigorous data analysis. Collaborate with subject matter experts to ensure consistency, relevance, and coverage across datasets. Qualifications Must-Have 5+ years of experience required; 10-25 years...Remote jobContract workSummer work$40 per hour
...Position: Application Users - Unreal Engine on Windows - Generalist Type: Contract Compensation: $30–$40/hour Location: Remote Role Responsibilities Evaluate the functionality and performance of Unreal Engine on Windows . Capture high-resolution...Remote jobContract workSummer workFlexible hoursMercor
San Francisco, CA8 days ago$110 per hour
.... Position: Mathematics Research Collaborator (Part-time) Type: Contract Compensation: $80–$110/hour Location: Remote Commitment: Up to 20 hours/week Role Responsibilities Review and evaluate research papers in mathematics for correctness...Remote jobContract workPart timeSummer workImmediate startMercor
San Francisco, CA10 days ago$12 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: PDF Annotation & Transcription Experts – Malayalam Type: Contract Compensation: $13/hour Location: Remote Role Responsibilities Source documents: find publicly accessible Malayalam PDFs...Remote workContract workWork experience placementSummer workMercor
San Francisco, CA21 days ago$80 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Accounting Expert Type: Contract Compensation: $70–$80/hour Location: Remote Role Responsibilities Construct accounting scenarios spanning financial statement...Remote jobContract workSummer workMercor
San Francisco, CA22 days ago$50 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: K-12 Education Expert Type: Contract Compensation: $40–$50/hour Location: Remote Role Responsibilities Construct K-12 scenarios spanning curriculum design, multi-...Remote jobContract workSummer workWork at officeMercor
San Francisco, CA12 days ago$60 per hour
...Type: Contract Compensation: $60/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities Evaluate... ...training data quality. Collaborate with subject matter experts to ensure consistency and relevance across datasets. Work...Remote jobContract workPart timeSummer workMercor
San Francisco, CA4 days ago$150 per hour
...Larry Summers , and Jack Dorsey . Position: Mathematics Researchers (Part-time) Type: Contract Compensation: $90-$150/hour Location: Remote Commitment: 8-20 hours/week Role Responsibilities Author and review challenging mathematics problems to train and evaluate frontier...Remote jobContract workPart timeSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Psychometrics Expert - Fully Remote | Upto $63/hr. Be the first to apply!
Related searches
- subject matter expert San Francisco, CA
- technology expert San Francisco, CA
- fulfillment expert San Francisco, CA
- guest service support expert San Francisco, CA
- sql expert San Francisco, CA
- software engineering manager remote San Francisco, CA
- remote recruitment consultant San Francisco, CA
- remote data manager San Francisco, CA
- senior php developer remote San Francisco, CA
- benefits specialist remote San Francisco, CA