Government Evaluator - Domain Expert - AI Trainer
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Government / public administration Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs.
- Collaborate with subject matter experts to ensure consistency and quality.
- Work independently and asynchronously to meet deadlines while enhancing AI model performance.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Government / public administration.
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Master's or higher from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercor$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Engineering / manufacturing / technical operations Evaluator Type: Contract Compensation: $... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify...SuggestedContract workSummer workWork at officeRemote work$90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of...SuggestedContract workSummer workLocal areaRemote work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $... ...Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in...SuggestedContract workSummer workWork at officeRemote work$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Program management / implementation planning Evaluator Type: Contract Compensation: $... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual...SuggestedContract workSummer workWork at officeRemote work$65 - $75 per unit
...and technical talent with leading AI research labs. Headquartered in... ...in the radiological safety domain, labeled as benign, dual-use, and adversarial. Evaluate model responses against a defined... ...responses. Collaborate with experts to ensure models correctly judge...SuggestedContract workSummer workRemote work$60 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Location: Remote Role Responsibilities Evaluate AI-generated responses for safety,... ...cyber, biosecurity, and other sensitive domains. Apply and refine evaluation rubrics for...Contract workSummer workRemote work$60 per hour
...technical talent with leading AI research labs. Headquartered in... ...and objective rubrics. Evaluate AI models on visual document... ...-following in the Education domain. Develop and refine evaluation... ...Collaborate with subject matter experts to ensure task relevance and...Contract workSummer workRemote work- ...seekers Career centers AI Skills Studio... ...Sign up INTELLIGENCE EXPERT (BACHELOR'S,... ...'S AND PHDS) - AI TRAINER Sign up now Up to... ...be to simulate and evaluate how malicious actors... ...want to apply their government or military... ...executable tactics, and domain-specific knowledge...Hourly payPart timeImmediate startRemote work10 hours per weekFlexible hours
$120 - $175 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Larry Summers , and Jack Dorsey . Position: CNC Machining Expert Type: Contract Compensation: $120–$175/hour Location...Contract workSummer workRemote work$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: General Clinician (MD/DO) - HLS Expert Pool Type: Contract Compensation... ...consistent model response grading. Evaluate clinical dialogues for accuracy safety...Full timeContract workSummer workRemote work$84 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Inorganic Chemistry & Synthesis Expert Type: Contract Compensation... .../week Role Responsibilities Evaluate technically complex problems involving...Full timeContract workSummer workRemote work$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., and Jack Dorsey . Position: Material Science PhD Coding Experts Type: Contract Compensation: $70/hour Location:...Contract workSummer workImmediate startRemote work- ...Create and evaluate prompts for AI in fine arts and design. About Turing: Turing is one of the world’s fastest-growing AI companies accelerating... ...Role Overview: We are seeking a highly qualified Art Domain Expert to evaluate and improve Large Language Models (LLMs). You...Contract workPart timeFor contractors
- ...Evaluate and improve AI responses using your domain expertise. About Turing: Based in San Francisco, California, Turing is the world’s leading research... ...the Role We are seeking highly qualified Domain Experts (SMEs) to support the evaluation, testing, and improvement...Part time
- ...Evaluate and improve AI responses in political science and governance. About Turing: Based in San Francisco, California, Turing is the world’s leading research... ...We are seeking a highly qualified Politics Domain Expert to evaluate and improve Large Language Models...Contract workPart timeFor contractors
$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: STEM PhDs and Technical Domain Experts Type: Contract Compensation:... ...developing difficult problems in your domain. Evaluate and improve AI model performance...Remote jobContract workSummer work$50 - $60 per hour
...technical talent with leading AI research labs.... ...Jack Dorsey . Position: Government & Public Policy Expert Type: Contract Compensation... ..., RFP/solicitation, and evaluation criteria. Develop... ...help us understand your sub-domain strengths. Qualified candidates...Contract workSummer workLocal areaRemote work- ...Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution... ...hiring a senior insurance and actuarial domain expert to work directly with a leading AI lab's... ...Design challenging insurance tasks and evaluation sets, and help build domain-specific...Full timeContract workPart timeFreelanceLive inRelocationRelocation package
$120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...'Angelo , Larry Summers , and Jack Dorsey . Position: Domain Expert – Legal (Lexis+ Research) Type: Contract Compensation:...Remote jobContract workSummer work- ...Evaluate and improve AI responses about film and television accuracy. About Turing: Turing is one of the world’s fastest-growing AI companies... ...: We are seeking a highly qualified TV Shows & Movies Domain Expert to evaluate and improve Large Language Models (LLMs). You...Contract workPart timeFor contractors
$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position STEM PhDs and Technical Domain Experts Type Contract Compensation $55-$80/hour... ...developing difficult problems in your domain. Evaluate and improve AI model performance through...Remote jobContract workSummer work$2,000 per unit
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: STEM Expert Task Pilot Type: Contract... ...push AI capabilities. Ensure tasks are evaluated automatically from 0 to 1 with partial credit...Full timeContract workSummer workRemote work$70 - $110 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...+ hours/week Role Responsibilities Evaluate AI-generated sales conversations , product... ...handling, and post-sale support. Provide expert feedback. Work independently and asynchronously...Hourly payContract workSummer workImmediate startRemote work$15 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation... ...+ hours/week Role Responsibilities Evaluate AI-generated music across various genres...Contract workSummer workImmediate startRemote workFlexible hours$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $... ...asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-Have...Contract workSummer workRemote work$8 - $65 per hour
...Job Application for Armenian Language Expert - Freelance AI Trainer Project at Meridial Back to jobs Armenian Language Expert - Freelance... ..., and suggest improvements to our prompt engineering and evaluation metrics. A Master's degree in Linguistics, Armenian Studies...Hourly payContract workPart timeFor contractorsFreelanceImmediate startRemote work$30 per hour
...to $30/hour ## About SME Careers As AI systems become more sophisticated, they rely... ...captures the full picture of how expert work actually gets done, the sequence of... ...diverse subjects. Optimize AI Performance: Evaluate and rank AI responses to enhance the model...Hourly payFull timeContract workFreelanceLocal areaRemote workFlexible hours$60 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Application Users - Windows 11 Professional Expert - Professionals Type: Contract Compensation... ...: Remote Role Responsibilities Evaluate and utilize Windows 11 Professional as...Contract workSummer workRemote work- Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution... ...please apply to the corresponding Legal Domain Expert listing instead — we run separate... ...depth: Design challenging legal tasks and evaluation sets, and help build legal-specific skills...Full timeContract workPart timeFreelanceInternshipLive inRelocationRelocation package
$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Sales Engineering Expert Type: Contract Compensation: $... ...objections, supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands...Contract workSummer workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Government Evaluator - Domain Expert - AI Trainer. Be the first to apply!
- quality evaluator San Francisco, CA
- evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- education evaluator San Francisco, CA
- ai evaluator San Francisco, CA
- work from home web search evaluator San Francisco, CA
- subject matter expert San Francisco, CA
- technology expert San Francisco, CA
- fulfillment expert San Francisco, CA
- guest service support expert San Francisco, CA



