Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Government Evaluator - Domain Expert - AI Trainer

$80 - $120 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Government / public administration Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
  • Provide clear, structured written feedback to improve AI model outputs.
  • Collaborate with subject matter experts to ensure consistency and quality.
  • Work independently and asynchronously to meet deadlines while enhancing AI model performance.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Government / public administration.
  • Native or professional fluency in English .
  • Highly proficient in Microsoft Office and Google Workspace , especially Slides .

Preferred

  • Master's or higher from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#hiringmercor
Vacancy posted 29 days ago
Similar jobs that could be interesting for youBased on the Government Evaluator - Domain Expert - AI Trainer in San Francisco, CA vacancy
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Engineering / manufacturing / technical operations Evaluator Type: Contract Compensation: $...  ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    9 days ago
  • $90 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of... 
    Suggested
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...customer research and feedback synthesis Evaluator Type: Contract Compensation: $...  ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    4 days ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $...  ...Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    26 days ago
  • $90 - $140 per hour

     ...technical talent with leading AI research labs. Headquartered in...  .... Design challenging, domain-relevant tasks, and write accurate...  ...responsible AI problems. Evaluate security and responsible AI...  ...Collaborate with other subject matter experts to ensure consistency and... 
    Suggested
    Contract work
    Summer work
    Remote work
    Weekday work

    Mercor

    San Francisco, CA
    8 days ago
  • $60 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...and objective rubrics. Evaluate AI models on visual document...  ...-following in the Education domain. Develop and refine evaluation...  ...Collaborate with subject matter experts to ensure task relevance and... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    1 day ago
  • $130k - $180k

     ...professional to serve as our Senior Safety Domain Expert for Veeva Falcon. In this role, you will...  ..., directly shaping next-generation AI and automation tools. You will spend your...  ...Calibration & Verification: Actively review, evaluate, and verify AI-driven platform outputs... 
    Work at office
    Local area
    Work from home
    Shift work

    Veeva Systems

    San Francisco, CA
    3 days ago
  • $60 - $100 per hour

     ...About the Role Join a generative AI research team to help improve how advanced...  ...work. You will bring professional domain judgment to task design model evaluation and benchmark development....  ...specialists in related fields to turn expert judgment into clear consistent evaluation... 
    Hourly pay
    Full time
    Live in
    Relocation

    Wintermeyer Ventures

    San Francisco, CA
    6 days ago
  •  ...We're building a research cohort of senior domain experts across seven specialist tracks — software/systems engineering, formal...  ...security, hardware design, and creative technology — to help evaluate how frontier AI models reason about hard, real-world expert-level... 
    Temporary work

    AfterQuery

    San Francisco, CA
    a month ago
  • $90 - $150 per hour

     ...: Medicine Join a leading AI lab's cutting-edge GenAI team...  ...Clinicians and Health subject-matter experts (SMEs) with clinical expertise...  ...health to bring deep clinical domain expertise and elevate the...  ...and health problems. Evaluate clinical medicine and health tasks... 
    Contract work
    Part time
    Weekday work

    Mercor

    San Francisco, CA
    7 days ago
  • $50 - $60 per hour

     ...technical talent with leading AI research labs....  ...Jack Dorsey . Position: Government & Public Policy Expert Type: Contract Compensation...  ..., RFP/solicitation, and evaluation criteria. Develop...  ...help us understand your sub-domain strengths. Qualified candidates... 
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    San Francisco, CA
    a month ago
  • Labelbox is seeking outbound recruiters to connect world-class experts with high-impact AI initiatives. You will identify PhDs, researchers, and seasoned professionals across specialized domains for Alignerr projects, leveraging academic networks and niche communities.... 
    Remote job

    Remote

    San Francisco, CA
    3 days ago
  •  ...infrastructure that powers breakthrough AI models at leading research...  ..., leveraging subject matter experts for next-generation AI models...  ...highly skilled annotators and domain experts for flexible scaling...  ...expertise to help develop, evaluate, and improve cutting-edge AI systems... 
    For contractors
    Work at office
    Remote work
    Flexible hours
    3 days per week

    Remote

    San Francisco, CA
    3 days ago
  • $80 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  .... Position: STEM PhDs and Technical Domain Experts Type: Contract Compensation:...  ...developing difficult problems in your domain. Evaluate and improve AI model performance... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    9 days ago
  • $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...'Angelo , Larry Summers , and Jack Dorsey . Position: Domain Expert – Legal (Lexis+ Research) Type: Contract Compensation:... 
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    11 days ago
  • $70 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ..., and Jack Dorsey . Position: Material Science PhD Coding Experts Type: Contract Compensation: $70/hour Location:... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    11 days ago
  • $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: General Clinician (MD/DO) - HLS Expert Pool Type: Contract Compensation...  ...for consistent model response grading. Evaluate clinical dialogues for accuracy, safety... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    10 days ago
  • $70 - $110 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...+ hours/week Role Responsibilities Evaluate AI-generated sales conversations , product...  ...handling, and post-sale support. Provide expert feedback. Work independently and asynchronously... 
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    25 days ago
  • $15 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation...  ...+ hours/week Role Responsibilities Evaluate AI-generated music across various genres... 
    Contract work
    Summer work
    Immediate start
    Remote work
    Flexible hours

    Mercor

    San Francisco, CA
    7 days ago
  • $57 per hour

     ...Job Description Job Description About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers... 
    Hourly pay
    Contract work
    For contractors
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    18 days ago
  • $84 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: Inorganic Chemistry & Synthesis Expert Type: Contract Compensation: $...  ...0 hours/week Role Responsibilities Evaluate technically complex problems involving inorganic... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    7 days ago
  • $85 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    1 day ago
  • $65 - $75 per unit

     ...technical talent with leading AI research labs. Headquartered in...  ...prompts in the radiological safety domain, labeled as benign, dual-use, and adversarial. Evaluate model responses against a...  ...responses. Collaborate with experts to ensure models correctly judge... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    4 days ago
  • $2,000 per unit

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ..., and Jack Dorsey . Position: STEM Expert Task Pilot Type: Contract Compensation...  ...AI capabilities. Ensure tasks are evaluated automatically from 0 to 1 with partial credit... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    6 days ago
  •  ...seekers Career centers AI Skills Studio...  ...Sign up INTELLIGENCE EXPERT (BACHELOR'S,...  ...'S AND PHDS) - AI TRAINER Sign up now Up to...  ...be to simulate and evaluate how malicious actors...  ...want to apply their government or military...  ...executable tactics, and domain-specific knowledge... 
    Hourly pay
    Part time
    Immediate start
    Remote work
    10 hours per week
    Flexible hours

    Handshake

    San Francisco, CA
    a month ago
  • $60 - $70 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Location: Remote Role Responsibilities Evaluate AI-generated responses for safety,...  ...cyber, biosecurity, and other sensitive domains. Apply and refine evaluation rubrics for... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    10 days ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Dorsey . Position: Sales Engineering Expert Type: Contract Compensation: $...  ...objections, supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    9 days ago
  • $120 per hour

     ...Prolific, located in San Francisco, is looking for Licensed Pharmacists to train and evaluate AI models. You will guide these systems by reviewing AI-generated pharmaceutical scenarios and providing your expertise. With competitive pay rates of up to $120 USD per hour... 
    Hourly pay
    Remote work
    Work from home
    Flexible hours

    Prolific

    San Francisco, CA
    4 days ago
  •  ...We're building an agentic AI caregiver advocate that lives...  ...complete medical history, navigates government benefits applications, and...  ...in one of the highest-stakes domains imaginable - where a wrong...  ...pipelines, tool-use frameworks, and evaluation infrastructure that make it... 
    Immediate start
    Remote work
    Flexible hours

    Citizen Health

    San Francisco, CA
    12 hours ago
  •  ...Job Description Job Description Benefits: ~401(k) ~401(k) matching ~ Bonus based on performance AI Domain Knowledge Engineer--Remote Create enterprise knowledge foundations using ingestion pipelines, vector databases, semantic retrieval, and knowledge... 
    Remote job

    DELTASOFT SOLUTIONS LLC

    San Francisco, CA
    22 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Government Evaluator - Domain Expert - AI Trainer. Be the first to apply!