Government Evaluator - Domain Expert - AI Trainer
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Government / public administration Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs.
- Collaborate with subject matter experts to ensure consistency and quality.
- Work independently and asynchronously to meet deadlines while enhancing AI model performance.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Government / public administration.
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Master's or higher from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 25 days ago
Similar jobs that could be interesting for youBased on the Government Evaluator - Domain Expert - AI Trainer in San Francisco, CA vacancy
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Biology / environmental science Evaluator Type: Contract Compensation: $80-$120/hour... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual...SuggestedContract workSummer workWork at officeRemote work- Mercor is seeking a Biology / environmental science Evaluator for a remote contract role. You will assess AI-generated artifacts using domain-specific rubrics, identify errors, and provide structured feedback to improve content quality. Candidates should have 5+ years in...SuggestedRemote jobContract workWork at office
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Engineering / manufacturing / technical operations Evaluator Type: Contract Compensation: $... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify...SuggestedContract workSummer workWork at officeRemote work$90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of...SuggestedContract workSummer workLocal areaRemote work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $... ...Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in...SuggestedContract workSummer workWork at officeRemote work$130k - $180k
...professional to serve as our Senior Safety Domain Expert for Veeva Falcon. In this role, you will... ..., directly shaping next-generation AI and automation tools. You will spend your... ...Calibration & Verification: Actively review, evaluate, and verify AI-driven platform outputs...Work at officeLocal areaWork from homeShift workVeeva Systems
San Francisco, CA4 days ago$90 - $150 per hour
...: Medicine Join a leading AI lab's cutting-edge GenAI team... ...Clinicians and Health subject-matter experts (SMEs) with clinical expertise... ...health to bring deep clinical domain expertise and elevate the... ...and health problems. Evaluate clinical medicine and health tasks...Contract workPart timeWeekday workMercor
San Francisco, CA3 days ago$60 - $100 per hour
...About the Role Join a generative AI research team to help improve how advanced... ...work. You will bring professional domain judgment to task design model evaluation and benchmark development.... ...specialists in related fields to turn expert judgment into clear consistent evaluation...Hourly payFull timeLive inRelocationWintermeyer Ventures
San Francisco, CA2 days ago- ...We're building a research cohort of senior domain experts across seven specialist tracks — software/systems engineering, formal... ...security, hardware design, and creative technology — to help evaluate how frontier AI models reason about hard, real-world expert-level...Temporary work
AfterQuery
San Francisco, CA29 days ago $30 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Hindi Linguistic Experts Type: Contract Compensation: $30/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated...Contract workSummer workRemote work- Remote is seeking a Mongolian Language Specialist to help train AI models. You will review and annotate Mongolian content, evaluate outputs for accuracy, and refine prompts and linguistic guidelines. Fluency in Mongolian and experience in translation, linguistics, language...Remote jobHourly payContract work
- Remote is seeking a Neuroscience Specialist - AI Trainer to help shape the future of AI by guiding neural models with rigorous neuroscience... ..., document failures, and propose improvements to prompts and evaluation metrics. This contract role requires a master’s or PhD in...Remote jobContract work
- Logoslabs is seeking a Yemeni Arabic language expert to guide AI training and evaluation. You will interact with the model in Yemeni Arabic, assess linguistic accuracy and cultural relevance, and document error traces to improve model reasoning. The role emphasizes transparency...Remote jobHourly payFor contractors
$90 per hour
...technical talent with leading AI research labs. Headquartered in... .... Design challenging, domain-relevant tasks, and write accurate... ...responsible AI problems. Evaluate security and responsible AI... ...Collaborate with other subject matter experts to ensure consistency and...Full timeContract workSummer workRemote workWeekday work$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Program management / implementation planning Evaluator Type: Contract Compensation: $... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual...Contract workSummer workWork at officeRemote work- ...infrastructure that powers breakthrough AI models at leading research... ..., leveraging subject matter experts for next-generation AI models... ...highly skilled annotators and domain experts for flexible scaling... ...expertise to help develop, evaluate, and improve cutting-edge AI systems...For contractorsWork at officeRemote workFlexible hours3 days per week
- Labelbox is seeking outbound recruiters to connect world-class experts with high-impact AI initiatives. You will identify PhDs, researchers, and seasoned professionals across specialized domains for Alignerr projects, leveraging academic networks and niche communities....Remote job
$60 per hour
...technical talent with leading AI research labs. Headquartered in... ...and objective rubrics. Evaluate AI models on visual document... ...-following in the Education domain. Develop and refine evaluation... ...Collaborate with subject matter experts to ensure task relevance and...Contract workSummer workRemote work- ...seekers Career centers AI Skills Studio... ...Sign up INTELLIGENCE EXPERT (BACHELOR'S,... ...'S AND PHDS) - AI TRAINER Sign up now Up to... ...be to simulate and evaluate how malicious actors... ...want to apply their government or military... ...executable tactics, and domain-specific knowledge...Hourly payPart timeImmediate startRemote work10 hours per weekFlexible hours
Handshake
San Francisco, CAa month ago $60 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Location: Remote Role Responsibilities Evaluate AI-generated responses for safety,... ...cyber, biosecurity, and other sensitive domains. Apply and refine evaluation rubrics for...Contract workSummer workRemote work- ...needs and what is delivered. Our AI-native platform, Air... ...coordinated execution system for government agencies and industrial suppliers... ...and training through evaluation and validation in real-world,... ...deep expertise in one or more domains.Own End-to-End Scientific Execution...Full timeWork at office
Air
San Francisco, CA4 days ago $85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-...Contract workSummer workRemote workMercor
San Francisco, CA27 days ago$120 per hour
...Prolific, located in San Francisco, is looking for Licensed Pharmacists to train and evaluate AI models. You will guide these systems by reviewing AI-generated pharmaceutical scenarios and providing your expertise. With competitive pay rates of up to $120 USD per hour...Hourly payRemote workWork from homeFlexible hoursProlific
San Francisco, CA58 minutes ago$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., and Jack Dorsey . Position: Material Science PhD Coding Experts Type: Contract Compensation: $70/hour Location:...Contract workSummer workImmediate startRemote work- ...We're building an agentic AI caregiver advocate that lives... ...complete medical history, navigates government benefits applications, and... ...in one of the highest-stakes domains imaginable - where a wrong... ...pipelines, tool-use frameworks, and evaluation infrastructure that make it...Immediate startRemote workFlexible hours
Citizen Health
San Francisco, CA1 day ago - ...Lead clinical reviews on complex dermatology cases for AI evaluation. About Turing: Turing’s mission is to accelerate superintelligence... ...development of clinical evaluation frameworks, and serve as expert advisor for client teams reviewing AI model outputs. The...Contract workPart timeFor contractorsFreelanceRemote workFlexible hours
Turing
San Francisco, CA14 days ago - ...Evaluate and improve AI models using sports knowledge and data analysis. About Turing: Based in San Francisco, California, Turing is... ...Role Overview: We are seeking a highly qualified Sports Domain Expert to evaluate and improve Large Language Models (LLMs). You...Contract workPart timeFor contractors
Turing
San Francisco, CAa month ago - ...Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution... ...a senior biochemistry and life sciences domain expert to work directly with a leading AI lab's... ...challenging life sciences tasks and evaluation sets, and help build domain-specific skills...Full timeContract workPart timeFreelanceLive inRelocationRelocation package
Mercor
San Francisco, CAa month ago $50 - $120 per hour
...strategic planning scenario evaluation written communication... ...micro1 is a data lab that helps AI labs & Enterprises train... ...recruiting agent sources and vets domain experts for our data platform that... ...Expert – U.S. & Allied Government Role Type: Contractor...Part timeFor contractorsRemote workmicro1
San Francisco, CA14 days ago$90 - $140 per hour
...USA Help define how frontier AI models reason about chemistry.... ...2\. Key Responsibilities Expert review: Assess chemistry tasks... ..., research-level problems and evaluation sets in your area of... ...or research organization. Domain depth: Genuine specialization...Hourly payContract workRemote workMercor
San Francisco, CA14 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Government Evaluator - Domain Expert - AI Trainer. Be the first to apply!
Related searches
- evaluator San Francisco, CA
- work from home web search evaluator San Francisco, CA
- ai evaluator San Francisco, CA
- education evaluator San Francisco, CA
- quality evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- technology expert San Francisco, CA
- subject matter expert San Francisco, CA
- guest service support expert San Francisco, CA
- fulfillment expert San Francisco, CA