AI Personal Assistant Evaluator
$50 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Personalized Life Assistant Expert
Type: Contract
Compensation: $50–$200/hour
Location: Remote
Commitment: 20–40 hours/week
Role Responsibilities
- Evaluate the effectiveness of AI systems in handling personalized, real-world tasks.
- Use AI tools extensively to assess the utility, personalization, and realism of AI responses.
- Analyze and improve AI outputs across domains like food, health, productivity, careers, and learning.
- Provide detailed feedback to enhance AI's understanding of context, preferences, and real-life success metrics.
- Work independently and asynchronously to meet deadlines and improve AI model performance .
Qualifications
Must-Have
- Heavy personal usage of LLM products .
- Experience with AI for multi-step tasks, planning, research, and decision-making.
- Familiarity with ChatGPT , Claude , Gemini , Perplexity , Cursor , Windsurf , Codex , or other AI agents .
- Ability to evaluate AI outputs for quality, safety, and realism.
- Strong written judgment and attention to detail.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
- Mercor is hiring a Healthcare Expert (contract, remote) to evaluate AI-generated medical responses and improve model reasoning. You will assess input data, compare outputs, and articulate reasons for superiority, focusing on clinical accuracy, safety, and sound medical...SuggestedRemote jobContract workImmediate start
- Planet Pharma is seeking experienced clinicians to evaluate frontier AI models in real clinical work. You will design realistic tasks such as SOAP notes, reconciliations, triage decisions, discharge summaries, patient education, or protocols, and run them through frontier...SuggestedRemote job
- Turing Enterprises, Inc. in the San Francisco area is seeking a freelance journalist to help evaluate and improve AI using newsroom expertise, editorial judgment, and clear communication. No prior AI experience required. You will design and assess real-world editorial and...SuggestedRemote jobFreelance
- Planet Pharma seeks experienced scientists and engineers to design and evaluate frontier AI models on real technical work, from data analysis to design verifications and reporting. Tasks are grounded in authentic practice and checked against professional standards, with...SuggestedRemote job
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location...SuggestedContract workSummer workWork at officeRemote work$70 - $110 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...weeks Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated operational plans , staff schedules, and performance...Hourly payContract workSummer workImmediate startRemote work$85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-...Contract workSummer workRemote work$15 per hour
...Experience: 1 - 3 years Join a 16-week research study evaluating AI assistants from the perspective of everyday users. We’re looking for people... ...consistently throughout the study using your own personal account on the assigned assistant. What we’re looking for...Full timeContract workPart timeImmediate start$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning and rigor in model...Contract workSummer workRemote work$20 per hour
...Rate: $20/hr Hours: 20 hours / week Experience: 1 - 3 years Help improve leading AI models through research, reasoning and educational evaluation. This remote opportunity is for students and working professionals who already use the Gemini App regularly for...Contract workImmediate startRemote work$70 per hour
...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers...Contract workSummer workImmediate startRemote work- ...About the role AI assistants are becoming part of everyday life, helping people with everything... ...select your preferred experience. Evaluate conversational quality, helpfulness,... ...least 3 times per week. Must have a personal ChatGPT Free or Plus account....Hourly payTemporary workPart timeRemote work
$10 - $30 per hour
...detail constructive feedback digital delivery platforms ai-driven tools familiarity independent work adaptability... ...Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM...Part timeFor contractorsRemote workShift work$20 - $160 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Position: Generalist Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour Location...Contract workSummer workRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: Data analysis / quantitative readouts Evaluator Type: Contract Compensation: $80–$120/hour...Contract workSummer workWork at officeRemote work$25 - $45 per hour
...Required Skills ChatGPT Muse AI agents Attention to Detail Following... ...foundational models and agents. We provide frontier evaluations and reinforcement learning environments... ...October 10th You’ll need: An active personal popular AI account (Free, Go, or Plus;...Part timeFor contractorsWork at officeWeekend work$150 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...discrete, checkable criteria for consistent model response grading. Evaluate clinical dialogues for accuracy, safety, completeness, and...Contract workSummer workRemote work$30 per hour
...technical talent with leading AI research labs. Headquartered... .... Collaborate with the AI assistant on tasks, guiding it, answering... ..., and correcting errors. Evaluate the experience and... ...use of AI chat assistants for personal and work-related questions....Hourly payWeekly payContract workFor contractorsSummer workRemote work- Virtual Data Entry Assistant (Part-Time)San Francisco, California, United StatesAbout the JobThis is a remote position.Job Title: Remote... .... This remote position offers a fantastic opportunity for personal and professional growth, and we can't wait to welcome you aboard...Part timeRemote workOverseasFlexible hours
$170 - $190 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Position: Primary Care Physician (MD) - Clinical Documentation & AI Evaluation Type: Contract Compensation: $170–$190/hour...Contract workWork experience placementSummer workRemote work$170 - $190 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Primary Care Physician (MD) - Outpatient Clinical Documentation & AI Evaluation Type: Contract Compensation: $170–$190/hour...Contract workWork experience placementSummer workRemote work$60 - $70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...$60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance...Contract workSummer workRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... .... Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote work$90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of...Contract workSummer workLocal areaRemote work$290k - $365k
...Anthropics mission is to create reliable interpretable and steerable AI systems. We want AI to be safe and beneficial for our users and... .... About the role Anthropic gives independent external evaluators access to our models our people and our safety practices so that...Full timeContract workWork at officeLocal areaVisa sponsorshipFlexible hours$100 - $150 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...00–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a software engineering...Contract workSummer workWork at officeRemote work$120k - $145k
...Our client, an early-stage tech startup developing next-generation technology, is looking for a highly resourceful & proactive Personal Assistant to support multiple founders. This is a hands-on, dynamic role for someone who loves solving problems, staying one step ahead...Flexible hoursWeekend workAfternoon shift$150k
This Personal Assistant role is working for a family based in San Francisco. As with many Personal Assistant roles, this role is varied. However, the schedule is consistent and the work environment is in someone's home. Ideally looking for someone who has been a Personal...For contractors3 days per week$35 - $40 per hour
...Part-time with no benefits Shift & Schedule: Position is in-person and requires flexibility to accommodate changing schedules Shifts... ...basis and may be non-standard Position Summary: Personal Assistants provide compassionate support and comprehensive services to empower...Part timeLocal areaWork from homeShift work$180k - $225k
...Personal Assistant Our trusted client is seeking a highly adaptable personal assistant to provide comprehensive executive support. This rewarding role involves frequent domestic and international travel, and requires someone who can operate comfortably within a structured...Flexible hoursShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Personal Assistant Evaluator. Be the first to apply!
- personal assistant San Francisco, CA
- education evaluator San Francisco, CA
- work from home web search evaluator San Francisco, CA
- evaluator San Francisco, CA
- ai evaluator San Francisco, CA
- quality evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- entry level personal training San Francisco, CA
- personal security San Francisco, CA
- personal injury legal assistant San Francisco, CA




