Generalist Expert - Data Evaluation

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Experienced Generalist Type: Contract Compensation: $45–$60/hour Location: Remote Commitment: 10–25 hours/week Role Responsibilities Create and evaluate base prompts across a range of generalist topics. Review and revise AI-generated responses for clarity, accuracy, and alignment with human reasoning. Develop prompt-response iterations using variations in length, style, and system prompts. Contribute to benchmarking efforts by identifying failure points in model responses. Create rubrics to evaluate the prompts and apply consistent quality standards across diverse content types. Qualifications Must-Have 2+ years of experience in research, education, writing, editing, or adjacent analytical fields. Proven ability to communicate complex topics clearly and concisely. Strong attention to detail and critical thinking skills. Comfort working independently with evolving task guidelines. Preferred Familiarity with LLMs or AI-assisted writing tools. Application Process (Takes 20–30 mins to complete) Submit your resume to get started. Complete the Domain Expert interview. We aim to follow up within a few business days. Resources & Support For details about the interview process and platform information, please check: For any help or support, reach out to: View email address on click.appcast.io PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity. #J-18808-Ljbffr Mercor