Government Evaluator - Domain Expert
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Government / public administration Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs.
- Collaborate with subject matter experts to ensure consistency and quality.
- Work independently and asynchronously to meet deadlines while enhancing AI model performance.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Government / public administration.
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Master's or higher from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 15 days ago
Similar jobs that could be interesting for youBased on the Government Evaluator - Domain Expert in San Francisco, CA vacancy
$80 - $120 per hour
...Position: Engineering / manufacturing / technical operations Evaluator Type: Contract Compensation: $80–$120/hour Location... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation...SuggestedContract workSummer workWork at officeRemote workMercor
San Francisco, CA13 days ago$60 - $70 per hour
...60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance... ..., self-harm, violence, cyber, biosecurity, and other sensitive domains. Apply and refine evaluation rubrics for RLHF , SFT ,...SuggestedContract workSummer workRemote workMercor
San Francisco, CA14 days ago$120 - $175 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: CNC Machining Expert Type: Contract Compensation: $120–$175/hour Location: Remote Role Responsibilities Contribute to text-only,...SuggestedContract workSummer workRemote workMercor
San Francisco, CA11 days ago- ...Evaluate and improve AI responses about film and television accuracy. About Turing: Turing is one of the world’s fastest-growing... ...: We are seeking a highly qualified TV Shows & Movies Domain Expert to evaluate and improve Large Language Models (LLMs). You will...SuggestedContract workPart timeFor contractors
Turing
San Francisco, CA7 days ago - ...Review complex physics problems and evaluate AI-generated scientific outputs. About Turing... ...Role Overview We are seeking Physics experts to contribute advanced scientific... ...consultation within your research or industry domain. Requirements PhD in Physics, Applied...SuggestedContract workPart timeFor contractorsFreelanceRemote workFlexible hours
Turing
San Francisco, CA2 days ago - ...Create and evaluate prompts for AI in fine arts and design. About Turing: Turing is one of the world’s fastest-growing AI companies... ...Role Overview: We are seeking a highly qualified Art Domain Expert to evaluate and improve Large Language Models (LLMs). You...Contract workPart timeFor contractors
Turing
San Francisco, CA7 days ago - ...Evaluate and improve AI responses using your domain expertise. About Turing: Based in San Francisco, California, Turing is the world’s leading research... ...the Role We are seeking highly qualified Domain Experts (SMEs) to support the evaluation, testing, and improvement...Part time
Turing
San Francisco, CA7 days ago - ...Overview We are hiring a senior insurance and actuarial domain expert to work directly with a leading AI lab's research and program... ...Benchmarks and domain depth: Design challenging insurance tasks and evaluation sets, and help build domain-specific skills and tools...Full timeContract workPart timeFreelanceLive inRelocationRelocation package
Mercor
San Francisco, CA7 days ago - ...Evaluate and improve AI responses in political science and governance. About Turing: Based in San Francisco, California, Turing is the world’s leading research... ...We are seeking a highly qualified Politics Domain Expert to evaluate and improve Large Language Models...Contract workPart timeFor contractors
Turing
San Francisco, CA7 days ago - ...Review complex materials science problems and evaluate AI-generated scientific outputs. About... ...: We are seeking Materials Science experts to contribute advanced scientific... ...consultation within your research or industry domain. Requirements PhD in Materials Science...Part time
Turing
San Francisco, CA2 days ago $100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour Location... ...and asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-Have ~5+ years of professional...Contract workSummer workRemote workMercor
San Francisco, CA22 days ago$80 per hour
...Summers , and Jack Dorsey . Position STEM PhDs and Technical Domain Experts Type Contract Compensation $55-$80/hour Location Remote Responsibilities... ...data by developing difficult problems in your domain. Evaluate and improve AI model performance through rigorous testing and...Remote jobContract workSummer work$50 per hour
...'Angelo , Larry Summers , and Jack Dorsey . Position: English Language and Literature Expert Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated English text across various use cases such as...Contract workSummer workRemote work- Domain Expert - Life Science (Dermatology) | Contractor | Remote (US-Based) Turing is seeking board-certified academic dermatologists to... ...dermatology faculty who want to apply their expertise to rigorous AI evaluation and clinical data infrastructure. About Turing Turing's...Remote jobFor contractorsFreelanceFlexible hours
$80 - $120 per hour
.... Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour Location... ...Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...Contract workSummer workWork at officeRemote work$50 - $60 per hour
..., and Jack Dorsey . Position: Government & Public Policy Expert Type: Contract Compensation... ...requirements, RFP/solicitation, and evaluation criteria. Develop program and grants... ...to help us understand your sub-domain strengths. Qualified candidates will...Contract workSummer workLocal areaRemote workMercor
San Francisco, CA13 days ago$15 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation: $15/hour... ...months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres and assess quality...Contract workSummer workImmediate startRemote workFlexible hoursMercor
San Francisco, CA11 days ago$80 per hour
..., and Jack Dorsey . Position: STEM PhDs and Technical Domain Experts Type: Contract Compensation: $55–$80/hour Location... ...data by developing difficult problems in your domain. Evaluate and improve AI model performance through rigorous testing and...Remote jobContract workSummer workMercor
San Francisco, CA13 days ago$120 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Domain Expert – Legal (Lexis+ Research) Type: Contract Compensation: $76–$120/hour Location: Remote Role Responsibilities...Remote jobContract workSummer workMercor
San Francisco, CA15 days ago$70 - $110 per hour
...weeks Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated sales conversations , product recommendations,... ..., order handling, and post-sale support. Provide expert feedback. Work independently and asynchronously to meet deadlines...Hourly payContract workSummer workImmediate startRemote workMercor
San Francisco, CA29 days ago$150 per hour
...Jack Dorsey . Position: General Clinician (MD/DO) - HLS Expert Pool Type: Contract Compensation: $150/hour Location... ..., checkable criteria for consistent model response grading. Evaluate clinical dialogues for accuracy, safety, completeness, and...Contract workSummer workRemote workMercor
San Francisco, CA14 days ago- ...General Counsel level, please apply to the corresponding Legal Domain Expert listing instead — we run separate listings by seniority so... ...Benchmarks and domain depth: Design challenging legal tasks and evaluation sets, and help build legal-specific skills and tools together...Full timeContract workPart timeFreelanceInternshipLive inRelocationRelocation package
$100 - $150 per hour
...Summers , and Jack Dorsey . Position: Sales Engineering Expert Type: Contract Compensation: $100–$150/hour Location... ...technical objections, supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands-on experience with technically...Contract workSummer workRemote workMercor
San Francisco, CA22 days ago$70 - $85 per hour
...Professional Services Practice Reviewer offers $70-$85/hour, focusing on evaluating AI-generated content, reviewing outputs, and ensuring... ...asynchronous work to deliver high-quality evaluations across domains, with PMP/CPA/CA preferred and a background in PM, law,...Remote jobContract work$90 per hour
...Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid . Write structured rationales for every...Contract workSummer workLocal areaRemote workMercor
San Francisco, CA8 days ago$100 - $150 per hour
..., Larry Summers , and Jack Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a software engineering context...Contract workSummer workWork at officeRemote workMercor
San Francisco, CAa month ago$1,500 per unit
...deliverables regarding common requests within the Real Estate domain. Diagnose and solve real issues in Real Estate to advance... ...Compensation & Legal Task-based payment upon first task approval. Experts qualify for hourly payment after first task completion....Hourly payContract workSummer workImmediate startRemote workFlexible hoursMercor
San Francisco, CA29 days ago- Execute bioinformatics workflows in UGENE by following detailed instructions. About Turing: Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. Turing helps customers in two ways: Working...Full timePart timeRemote work
Turing
San Francisco, CA7 days ago - Complete aerodynamic analysis workflows using Flow5 for various geometries. About Turing: Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. Turing helps customers in two ways: Working...Full timePart timeRemote work
Turing
San Francisco, CA7 days ago $50 per hour
What You'll Do Translate a familiar, complex workflow into a demanding prompt for an AI model Test your prompt using ChatGPT to identify where the model fails to produce a complete file Record your screen, camera, and microphone while thinking through the task Write...Contract workTemporary workFor contractorsRemote workTerac
San Francisco, CA7 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Government Evaluator - Domain Expert. Be the first to apply!
Related searches
- quality evaluator San Francisco, CA
- evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- education evaluator San Francisco, CA
- ai evaluator San Francisco, CA
- work from home web search evaluator San Francisco, CA
- subject matter expert San Francisco, CA
- technology expert San Francisco, CA
- fulfillment expert San Francisco, CA
- guest service support expert San Francisco, CA