Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Government Evaluator - Domain Expert - AI Trainer

$80 - $120 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Government / public administration Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
  • Provide clear, structured written feedback to improve AI model outputs.
  • Collaborate with subject matter experts to ensure consistency and quality.
  • Work independently and asynchronously to meet deadlines while enhancing AI model performance.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Government / public administration.
  • Native or professional fluency in English .
  • Highly proficient in Microsoft Office and Google Workspace , especially Slides .

Preferred

  • Master's or higher from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#hiringmercor
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Government Evaluator - Domain Expert - AI Trainer in San Francisco, CA vacancy
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Engineering / manufacturing / technical operations Evaluator Type: Contract Compensation: $...  ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    25 days ago
  • $90 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of... 
    Suggested
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    San Francisco, CA
    8 days ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $...  ...Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Program management / implementation planning Evaluator Type: Contract Compensation: $...  ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    5 days ago
  • $65 - $75 per unit

     ...and technical talent with leading AI research labs. Headquartered in...  ...in the radiological safety domain, labeled as benign, dual-use, and adversarial. Evaluate model responses against a defined...  ...responses. Collaborate with experts to ensure models correctly judge... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    22 days ago
  • $60 - $70 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Location: Remote Role Responsibilities Evaluate AI-generated responses for safety,...  ...cyber, biosecurity, and other sensitive domains. Apply and refine evaluation rubrics for... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    14 days ago
  • $60 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...and objective rubrics. Evaluate AI models on visual document...  ...-following in the Education domain. Develop and refine evaluation...  ...Collaborate with subject matter experts to ensure task relevance and... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    5 days ago
  •  ...seekers Career centers AI Skills Studio...  ...Sign up INTELLIGENCE EXPERT (BACHELOR'S,...  ...'S AND PHDS) - AI TRAINER Sign up now Up to...  ...be to simulate and evaluate how malicious actors...  ...want to apply their government or military...  ...executable tactics, and domain-specific knowledge... 
    Hourly pay
    Part time
    Immediate start
    Remote work
    10 hours per week
    Flexible hours

    Handshake

    San Francisco, CA
    7 days ago
  • $120 - $175 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Larry Summers , and Jack Dorsey . Position: CNC Machining Expert Type: Contract Compensation: $120–$175/hour Location... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    11 days ago
  • $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: General Clinician (MD/DO) - HLS Expert Pool Type: Contract Compensation...  ...consistent model response grading. Evaluate clinical dialogues for accuracy safety... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    12 days ago
  • $84 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: Inorganic Chemistry & Synthesis Expert Type: Contract Compensation...  .../week Role Responsibilities Evaluate technically complex problems involving... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    10 days ago
  • $70 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ..., and Jack Dorsey . Position: Material Science PhD Coding Experts Type: Contract Compensation: $70/hour Location:... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    15 days ago
  •  ...Create and evaluate prompts for AI in fine arts and design. About Turing: Turing is one of the world’s fastest-growing AI companies accelerating...  ...Role Overview: We are seeking a highly qualified Art Domain Expert to evaluate and improve Large Language Models (LLMs). You... 
    Contract work
    Part time
    For contractors

    Turing

    San Francisco, CA
    7 days ago
  •  ...Evaluate and improve AI responses using your domain expertise. About Turing: Based in San Francisco, California, Turing is the world’s leading research...  ...the Role We are seeking highly qualified Domain Experts (SMEs) to support the evaluation, testing, and improvement... 
    Part time

    Turing

    San Francisco, CA
    7 days ago
  •  ...Evaluate and improve AI responses in political science and governance. About Turing: Based in San Francisco, California, Turing is the world’s leading research...  ...We are seeking a highly qualified Politics Domain Expert to evaluate and improve Large Language Models... 
    Contract work
    Part time
    For contractors

    Turing

    San Francisco, CA
    7 days ago
  • $80 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  .... Position: STEM PhDs and Technical Domain Experts Type: Contract Compensation:...  ...developing difficult problems in your domain. Evaluate and improve AI model performance... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    13 days ago
  • $50 - $60 per hour

     ...technical talent with leading AI research labs....  ...Jack Dorsey . Position: Government & Public Policy Expert Type: Contract Compensation...  ..., RFP/solicitation, and evaluation criteria. Develop...  ...help us understand your sub-domain strengths. Qualified candidates... 
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    San Francisco, CA
    13 days ago
  •  ...Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution...  ...hiring a senior insurance and actuarial domain expert to work directly with a leading AI lab's...  ...Design challenging insurance tasks and evaluation sets, and help build domain-specific... 
    Full time
    Contract work
    Part time
    Freelance
    Live in
    Relocation
    Relocation package

    Mercor

    San Francisco, CA
    7 days ago
  • $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...'Angelo , Larry Summers , and Jack Dorsey . Position: Domain Expert – Legal (Lexis+ Research) Type: Contract Compensation:... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    15 days ago
  •  ...Evaluate and improve AI responses about film and television accuracy. About Turing: Turing is one of the world’s fastest-growing AI companies...  ...: We are seeking a highly qualified TV Shows & Movies Domain Expert to evaluate and improve Large Language Models (LLMs). You... 
    Contract work
    Part time
    For contractors

    Turing

    San Francisco, CA
    7 days ago
  • $80 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Dorsey . Position STEM PhDs and Technical Domain Experts Type Contract Compensation $55-$80/hour...  ...developing difficult problems in your domain. Evaluate and improve AI model performance through... 
    Remote job
    Contract work
    Summer work

    mercor

    San Francisco, CA
    1 day ago
  • $2,000 per unit

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...and Jack Dorsey . Position: STEM Expert Task Pilot Type: Contract...  ...push AI capabilities. Ensure tasks are evaluated automatically from 0 to 1 with partial credit... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    14 days ago
  • $70 - $110 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...+ hours/week Role Responsibilities Evaluate AI-generated sales conversations , product...  ...handling, and post-sale support. Provide expert feedback. Work independently and asynchronously... 
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    29 days ago
  • $15 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation...  ...+ hours/week Role Responsibilities Evaluate AI-generated music across various genres... 
    Contract work
    Summer work
    Immediate start
    Remote work
    Flexible hours

    Mercor

    San Francisco, CA
    11 days ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $...  ...asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-Have... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    22 days ago
  • $8 - $65 per hour

     ...Job Application for Armenian Language Expert - Freelance AI Trainer Project at Meridial Back to jobs Armenian Language Expert - Freelance...  ..., and suggest improvements to our prompt engineering and evaluation metrics. A Master's degree in Linguistics, Armenian Studies... 
    Hourly pay
    Contract work
    Part time
    For contractors
    Freelance
    Immediate start
    Remote work

    Invisible Technologies

    San Francisco, CA
    7 days ago
  • $30 per hour

     ...to $30/hour ## About SME Careers As AI systems become more sophisticated, they rely...  ...captures the full picture of how expert work actually gets done, the sequence of...  ...diverse subjects. Optimize AI Performance: Evaluate and rank AI responses to enhance the model... 
    Hourly pay
    Full time
    Contract work
    Freelance
    Local area
    Remote work
    Flexible hours

    SuperAnnotate

    San Francisco, CA
    7 days ago
  • $60 - $70 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Application Users - Windows 11 Professional Expert - Professionals Type: Contract Compensation...  ...: Remote Role Responsibilities Evaluate and utilize Windows 11 Professional as... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    8 days ago
  • Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution...  ...please apply to the corresponding Legal Domain Expert listing instead — we run separate...  ...depth: Design challenging legal tasks and evaluation sets, and help build legal-specific skills... 
    Full time
    Contract work
    Part time
    Freelance
    Internship
    Live in
    Relocation
    Relocation package

    Mercor

    San Francisco, CA
    2 days ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Dorsey . Position: Sales Engineering Expert Type: Contract Compensation: $...  ...objections, supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    22 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Government Evaluator - Domain Expert - AI Trainer. Be the first to apply!