Psychometrics Expert - Fully Remote | Upto $63/hr
$63 per hourMercor
New York, NY
- Remote job
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Applied Psychology Benchmark Specialist
Type: Contract
Compensation: $50–$63/hour
Location: Remote
Commitment: 10+ hours/week
Role Responsibilities
- Author original psychology questions that test deep conceptual understanding, not surface-level recall.
- Ensure questions are unambiguous, self-contained, and precisely defined with all necessary information in the problem statement.
- Rate each question's difficulty as Medium, Hard, or Expert to guide AI model training.
- Provide one correct answer and nine plausible but subtly incorrect alternatives to challenge expert-level solvers.
- Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format.
- Supply 1–5 academic references per question from reputable sources like peer-reviewed journals and university repositories.
- For verification tasks, flag issues with clarity, completeness, precision, or solvability and justify any edits made.
Qualifications
Must-Have
- PhD , PsyD , or doctoral candidate in Psychology or a closely related field.
- Master's degree considered for candidates with exceptional depth in a specific subdomain.
- Strong command of graduate-level psychological theory, research methodology, and empirical literature.
- Excellent written English and ability to express complex ideas clearly and concisely.
Preferred
- Clinical licensure or research publications in psychology .
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the Psychometrics Expert - Fully Remote | Upto $63/hr in New York, NY vacancy
$63 per hour
...Benchmark Specialist Type: Contract Compensation: $50–$63/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities... .... Rate each question's difficulty as Medium, Hard, or Expert. Provide 1 correct answer and 9 plausible but subtly...Remote jobContract workSummer work$63 per hour
...Benchmark Specialist Type: Contract Compensation: $50–$63/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities... ...(intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above). Provide 1 correct answer and...Remote jobContract workSummer work$110 per hour
We are seeking U.S.-based experts with direct underwriting experience in the Excess & Specialty Insurance market, particularly underwriting SME/commercial accounts . Engagement Details Initial pilot: 4 experts Duration: 1 week Commitment: ~20 hours per expert Potential...Remote job$120 per hour
About the role We are hiring expert Evaluators in Customer success / support operations to review and assess AI-generated work products... ...apply deep subject‑matter expertise to grade outputs. This is a remote, hourly engagement. Requirements (must have) 5+ years of relevant...Remote jobHourly payWork at office$180 per hour
...reasoning data. We're hiring Internal Medicine experts to design clinical scenarios, evaluate... ...medical license Rates $130-$300/hr payable , set per seniority tier (early-career... ...rate is confirmed in your offer. Engagement Remote, 100% asynchronous 20 hrs/wk default (can...Remote jobWeekly payWork at office$70 per hour
...handle specialized chemistry topics. No prior AI/ML experience is required — we'll train you on the workflow. What you'll do Write expert‑level prompts across specialized chemistry topics. Evaluate and annotate model responses for scientific accuracy, helpfulness, and...Remote jobPart timeImmediate start$100 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Excel Expert — Office / Retail Management Type: Contract Compensation: $70-$100/hour Location: Remote Commitment: 20+ hours/week Role Responsibilities Guide research teams to close...Remote jobContract workSummer workWork at officeWeekday work$63 per hour
...Benefits Insights Type: Contract Compensation: $63 total Location: Remote Duration: Approximately 25 minutes Role... ...title such as CHRO or Chief People Officer, VP or Head of HR, Benefits, or Total Rewards, Director of HR, Benefits, or...Remote jobContract workSummer work$120 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Domain Expert – Legal (Lexis+ Research) Type: Contract Compensation: $76–$120/hour Location: Remote Role Responsibilities Confirm every case, statute, and regulation is still...Remote jobContract workSummer work$100 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Investor Relations Expert Type: Contract Compensation: $100/hour Location: Remote Role Responsibilities Draft earnings releases, prepared remarks, and Q&A briefings for...Remote jobContract workSummer work$70 per hour
...Summers , and Jack Dorsey . Position: Application Users - Linux Ubuntu 24.04 Expert - Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate the usability and functionality of Linux Ubuntu...Remote jobContract workSummer work$90 per hour
...Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role Responsibilities... ...Work as a team by sharing insights with researchers and fellow experts to continually improve the benchmark. Qualifications Must...Remote jobContract workSummer work$120 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Domain Expert – Banking (Oracle FLEXCUBE Research) Type: Contract Compensation: $75–$120/hour Location: Remote Role Responsibilities Confirm the customer/contract position reflects...Remote jobContract workSummer work$90 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Chess Expert (1800+ ELO) — Game Reconstruction & Transcript Correction Type: Contract Compensation: $90/hour Location: Remote Role Responsibilities Evaluate and correct speech-to-text...Remote jobContract workSummer workFlexible hours$90 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product Management Expert Type: Contract Compensation: $80–$90/hour Location: Remote Role Responsibilities Construct enterprise product scenarios for multi-quarter roadmap...Remote jobContract workSummer work$160 per hour
...Dorsey . Position: Engineering / Platform Professionals Type: Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-specific documents to ensure quality, accuracy, and relevance. Provide structured...Remote jobContract workSummer work$54 per hour
...D'Angelo , Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - English (US/UK/Australia) Type: Contract Compensation: $23–$54/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities...Remote jobContract workSummer workImmediate start$60 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Expert Project Manager Type: Contract Compensation: $50–$60/hour Location: Remote Role Responsibilities Track project and annotator performance using Google Sheets...Remote jobContract workSummer work$100 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal Domain Expert — AI Training & Evaluation Type: Contract Compensation: $60–$100/hour Location: Hybrid, Bay Area, California...Remote jobContract workSummer work$90 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product Management Expert Type: Contract Compensation: $80–$90/hour Location: Remote Role Responsibilities Construct enterprise product scenarios for multi-quarter roadmap...Remote jobContract workSummer work$190 per hour
...: Contract Compensation: $170–$190/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities Review... ...teams can act on to improve AI systems . Contribute expert input on annotation guidelines, documentation standards, and edge...Remote jobContract workWork experience placementSummer work$150 per hour
...Position: Clinical Documentation Integrity (CDI) Specialist Type: Contract Compensation: $50–$150/hour Location: Remote Role Responsibilities Review AI-agent attempts at realistic CDI/coding tasks . Judge whether each disposition is correct...Remote jobContract workSummer work$140 per hour
...Larry Summers , and Jack Dorsey . Position: Healthcare Survey Research & Pharma Insights Expert Type: Contract Compensation: $140/hour Location: Remote Role Responsibilities Design, review, and refine physician and patient survey...Remote jobContract workSummer work$60 per hour
...Type: Contract Compensation: $60/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities Author... ...educational content . Collaborate with subject matter experts to ensure task relevance and accuracy. Work independently...Remote jobContract workPart timeSummer work$140 per hour
...Summers , and Jack Dorsey . Position: Mechanical, Electrical & Plumbing (MEP) Expert — Data Centers Type: Contract Compensation: $100–$140/hour Location: Remote Commitment: 5–10 hours/week Role Responsibilities Review complex engineering...Remote jobContract workSummer workImmediate start$90 per hour
..., and Jack Dorsey . Position: Kubernetes Task Auditor Type: Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate the quality and correctness of Kubernetes tasks for training and evaluating AI models. Assess...Remote jobContract workSummer work$77 per hour
...Type: Contract Compensation: $61–$77/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities... ...information. Rate each question's difficulty: Medium, Hard, or Expert. Provide 1 correct answer and 9 plausible incorrect alternatives...Remote jobContract workSummer work$19 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Telugu Type: Contract Compensation: $11–$19/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities...Remote jobContract workSummer workImmediate start$120 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal Expert — Immigration (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~6 hours Role Responsibilities Read a synthetic legal matter...Remote jobContract workSummer work$70 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Higher Education Expert Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct higher education scenarios for curriculum and program...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Psychometrics Expert - Fully Remote | Upto $63/hr. Be the first to apply!
Related searches
- guest service support expert New York, NY
- fulfillment expert New York, NY
- subject matter expert New York, NY
- sql expert New York, NY
- technology expert New York, NY
- remote reviewer New York, NY
- remote veterinarian New York, NY
- remote property manager New York, NY
- marketing assistant remote New York, NY
- remote sales consultant New York, NY