Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Personal Assistant Evaluator

$50 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Personalized Life Assistant Expert
Type: Contract
Compensation: $50–$200/hour
Location: Remote
Commitment: 20–40 hours/week

Role Responsibilities

  • Evaluate the effectiveness of AI systems in handling personalized, real-world tasks.
  • Use AI tools extensively to assess the utility, personalization, and realism of AI responses.
  • Analyze and improve AI outputs across domains like food, health, productivity, careers, and learning.
  • Provide detailed feedback to enhance AI's understanding of context, preferences, and real-life success metrics.
  • Work independently and asynchronously to meet deadlines and improve AI model performance .

Qualifications

Must-Have

  • Heavy personal usage of LLM products .
  • Experience with AI for multi-step tasks, planning, research, and decision-making.
  • Familiarity with ChatGPT , Claude , Gemini , Perplexity , Cursor , Windsurf , Codex , or other AI agents .
  • Ability to evaluate AI outputs for quality, safety, and realism.
  • Strong written judgment and attention to detail.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 9 days ago
Similar jobs that could be interesting for youBased on the AI Personal Assistant Evaluator in San Francisco, CA vacancy
  • Mercor is hiring a Healthcare Expert (contract, remote) to evaluate AI-generated medical responses and improve model reasoning. You will assess input data, compare outputs, and articulate reasons for superiority, focusing on clinical accuracy, safety, and sound medical... 
    Suggested
    Remote job
    Contract work
    Immediate start

    Mercor

    San Francisco, CA
    4 days ago
  • Planet Pharma is seeking experienced clinicians to evaluate frontier AI models in real clinical work. You will design realistic tasks such as SOAP notes, reconciliations, triage decisions, discharge summaries, patient education, or protocols, and run them through frontier... 
    Suggested
    Remote job

    Planet Pharma

    San Francisco, CA
    2 days ago
  • Turing Enterprises, Inc. in the San Francisco area is seeking a freelance journalist to help evaluate and improve AI using newsroom expertise, editorial judgment, and clear communication. No prior AI experience required. You will design and assess real-world editorial and... 
    Suggested
    Remote job
    Freelance

    Turing

    San Francisco, CA
    4 days ago
  • Planet Pharma seeks experienced scientists and engineers to design and evaluate frontier AI models on real technical work, from data analysis to design verifications and reporting. Tasks are grounded in authentic practice and checked against professional standards, with... 
    Suggested
    Remote job

    Planet Pharma

    San Francisco, CA
    2 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    1 day ago
  • $70 - $110 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...weeks Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated operational plans , staff schedules, and performance... 
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    29 days ago
  • $85 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  • $15 per hour

     ...Experience: 1 - 3 years Join a 16-week research study evaluating AI assistants from the perspective of everyday users. We’re looking for people...  ...consistently throughout the study using your own personal account on the assigned assistant. What we’re looking for... 
    Full time
    Contract work
    Part time
    Immediate start

    Braintrust

    San Francisco, CA
    9 days ago
  • $70 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning and rigor in model... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    29 days ago
  • $20 per hour

     ...Rate: $20/hr Hours: 20 hours / week Experience: 1 - 3 years Help improve leading AI models through research, reasoning and educational evaluation. This remote opportunity is for students and working professionals who already use the Gemini App regularly for... 
    Contract work
    Immediate start
    Remote work

    Braintrust

    San Francisco, CA
    23 days ago
  • $70 per hour

     ...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    13 days ago
  •  ...About the role AI assistants are becoming part of everyday life, helping people with everything...  ...select your preferred experience. Evaluate conversational quality, helpfulness,...  ...least 3 times per week. Must have a personal ChatGPT Free or Plus account.... 
    Hourly pay
    Temporary work
    Part time
    Remote work

    micro1

    San Francisco, CA
    7 days ago
  • $10 - $30 per hour

     ...detail constructive feedback digital delivery platforms ai-driven tools familiarity independent work adaptability...  ...Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM... 
    Part time
    For contractors
    Remote work
    Shift work

    micro1

    San Francisco, CA
    24 days ago
  • $20 - $160 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Position: Generalist Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour Location... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    1 day ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Jack Dorsey . Position: Data analysis / quantitative readouts Evaluator Type: Contract Compensation: $80–$120/hour... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    11 days ago
  • $25 - $45 per hour

     ...Required Skills ChatGPT Muse AI agents Attention to Detail Following...  ...foundational models and agents. We provide frontier evaluations and reinforcement learning environments...  ...October 10th You’ll need: An active personal popular AI account (Free, Go, or Plus;... 
    Part time
    For contractors
    Work at office
    Weekend work

    micro1

    San Francisco, CA
    15 days ago
  • $150 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...discrete, checkable criteria for consistent model response grading. Evaluate clinical dialogues for accuracy, safety, completeness, and... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    12 days ago
  • $30 per hour

     ...technical talent with leading AI research labs. Headquartered...  .... Collaborate with the AI assistant on tasks, guiding it, answering...  ..., and correcting errors. Evaluate the experience and...  ...use of AI chat assistants for personal and work-related questions.... 
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    20 days ago
  • Virtual Data Entry Assistant (Part-Time)San Francisco, California, United StatesAbout the JobThis is a remote position.Job Title: Remote...  .... This remote position offers a fantastic opportunity for personal and professional growth, and we can't wait to welcome you aboard... 
    Part time
    Remote work
    Overseas
    Flexible hours

    Link Up Overseas

    San Francisco, CA
    12 hours ago
  • $170 - $190 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Position: Primary Care Physician (MD) - Clinical Documentation & AI Evaluation Type: Contract Compensation: $170–$190/hour... 
    Contract work
    Work experience placement
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    10 days ago
  • $170 - $190 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Primary Care Physician (MD) - Outpatient Clinical Documentation & AI Evaluation Type: Contract Compensation: $170–$190/hour... 
    Contract work
    Work experience placement
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    18 days ago
  • $60 - $70 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...$60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    12 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  .... Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  • $90 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of... 
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  • $290k - $365k

     ...Anthropics mission is to create reliable interpretable and steerable AI systems. We want AI to be safe and beneficial for our users and...  .... About the role Anthropic gives independent external evaluators access to our models our people and our safety practices so that... 
    Full time
    Contract work
    Work at office
    Local area
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    5 days ago
  • $100 - $150 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...00–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a software engineering... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    14 days ago
  • $120k - $145k

     ...Our client, an early-stage tech startup developing next-generation technology, is looking for a highly resourceful & proactive Personal Assistant to support multiple founders. This is a hands-on, dynamic role for someone who loves solving problems, staying one step ahead... 
    Flexible hours
    Weekend work
    Afternoon shift

    BURKE+CO

    San Francisco, CA
    2 days ago
  • $150k

    This Personal Assistant role is working for a family based in San Francisco. As with many Personal Assistant roles, this role is varied. However, the schedule is consistent and the work environment is in someone's home. Ideally looking for someone who has been a Personal... 
    For contractors
    3 days per week

    Rapaport Household

    San Francisco, CA
    1 day ago
  • $35 - $40 per hour

     ...Part-time with no benefits Shift & Schedule: Position is in-person and requires flexibility to accommodate changing schedules Shifts...  ...basis and may be non-standard Position Summary: Personal Assistants provide compassionate support and comprehensive services to empower... 
    Part time
    Local area
    Work from home
    Shift work

    Jewish Family Children's Services of the Suncoast

    San Francisco, CA
    3 days ago
  • $180k - $225k

     ...Personal Assistant Our trusted client is seeking a highly adaptable personal assistant to provide comprehensive executive support. This rewarding role involves frequent domestic and international travel, and requires someone who can operate comfortably within a structured... 
    Flexible hours
    Shift work

    Propel Recruitment LLC

    San Francisco, CA
    12 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Personal Assistant Evaluator. Be the first to apply!