Government Evaluator - Domain Expert
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Government / public administration Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs.
- Collaborate with subject matter experts to ensure consistency and quality.
- Work independently and asynchronously to meet deadlines while enhancing AI model performance.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Government / public administration.
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Master's or higher from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 8 days ago
Similar jobs that could be interesting for youBased on the Government Evaluator - Domain Expert in San Francisco, CA vacancy
- Mercor is seeking a Biology / environmental science Evaluator for a remote contract role. You will assess AI-generated artifacts using domain-specific rubrics, identify errors, and provide structured feedback to improve content quality. Candidates should have 5+ years in...SuggestedRemote jobContract workWork at office
$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80-$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...SuggestedContract workSummer workWork at officeRemote work$80 - $120 per hour
...Position: Engineering / manufacturing / technical operations Evaluator Type: Contract Compensation: $80–$120/hour Location... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation...SuggestedContract workSummer workWork at officeRemote work$130k - $180k
...pharmacovigilance professional to serve as our Senior Safety Domain Expert for Veeva Falcon. In this role, you will bridge hands-on case... ...workflows AI Calibration & Verification: Actively review, evaluate, and verify AI-driven platform outputs across case intake and...SuggestedWork at officeLocal areaWork from homeShift workVeeva Systems
San Francisco, CA5 days ago$60 - $100 per hour
...insurance and actuarial work. You will bring professional domain judgment to task design model evaluation and benchmark development. What Youll Do... ...researchers and specialists in related fields to turn expert judgment into clear consistent evaluation criteria....SuggestedHourly payFull timeLive inRelocationWintermeyer Ventures
San Francisco, CA3 days ago$110 per hour
...Senior Clinical Medicine Domain Expert Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where... ...Benchmarks and domain depth: Design challenging clinical tasks and evaluation sets, and help build medicine-specific skills and tools...Full timeContract workPart timeFreelanceLive inRelocationRelocation package$50 - $60 per hour
..., and Jack Dorsey . Position: Government & Public Policy Expert Type: Contract Compensation... ...requirements, RFP/solicitation, and evaluation criteria. Develop program and grants... ...to help us understand your sub-domain strengths. Qualified candidates will...Contract workSummer workLocal areaRemote workMercor
San Francisco, CAa month ago- ...We're building a research cohort of senior domain experts across seven specialist tracks — software/systems engineering, formal methods... ...security, hardware design, and creative technology — to help evaluate how frontier AI models reason about hard, real-world expert-level...Temporary work
AfterQuery
San Francisco, CAa month ago $90 - $150 per hour
...licensed Clinicians and Health subject-matter experts (SMEs) with clinical expertise and active... ...or allied health to bring deep clinical domain expertise and elevate the quality of our... ...medicine and health problems. Evaluate clinical medicine and health tasks and solutions...Contract workPart timeWeekday workMercor
San Francisco, CA4 days ago$30 per hour
...Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Hindi Linguistic Experts Type: Contract Compensation: $30/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated Hindi text across various use cases, including...Contract workSummer workRemote work$80 - $120 per hour
.... Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour Location... ...Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...Contract workSummer workWork at officeRemote work- Labelbox is seeking outbound recruiters to connect world-class experts with high-impact AI initiatives. You will identify PhDs, researchers, and seasoned professionals across specialized domains for Alignerr projects, leveraging academic networks and niche communities....Remote job
- ...through Alignerr, leveraging subject matter experts for next-generation AI models Expert... ...teams with highly skilled annotators and domain experts for flexible scaling Why Join Us... ...contribute their expertise to help develop, evaluate, and improve cutting-edge AI systems. We'...For contractorsWork at officeRemote workFlexible hours3 days per week
$1,500 per unit
...and deliverables for common requests within your professional domain. Diagnose and solve real issues in the Medical and Health Services... ...Legal Task-based payment upon first task approval. Qualified experts paid hourly for the remainder of the project. Resources &...Hourly payContract workSummer workImmediate startRemote work$60 - $70 per hour
...60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance... ..., self-harm, violence, cyber, biosecurity, and other sensitive domains. Apply and refine evaluation rubrics for RLHF , SFT ,...Contract workSummer workRemote work$90 per hour
...Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid . Write structured rationales for every...Contract workSummer workLocal areaRemote workMercor
San Francisco, CAa month ago$120 per hour
...Prolific, located in San Francisco, is looking for Licensed Pharmacists to train and evaluate AI models. You will guide these systems by reviewing AI-generated pharmaceutical scenarios and providing your expertise. With competitive pay rates of up to $120 USD per hour...Hourly payRemote workWork from homeFlexible hoursProlific
San Francisco, CA17 hours ago$90 - $140 per hour
...fully remote. 2\. Key Responsibilities Expert review: Assess life sciences tasks and... ..., research-level problems and evaluation sets in your area of specialization.... ...laboratory, or research organization. Domain depth: Genuine specialization in at least...Hourly payContract workRemote workMercor
San Francisco, CA15 days ago- ...Evaluate and improve AI responses in music theory and genres. About Turing: Based in San Francisco, California, Turing is the... ...Role Overview: We are seeking a highly qualified Music Domain Expert to evaluate and improve Large Language Models (LLMs). You...Contract workPart timeFor contractors
Turing
San Francisco, CAa month ago $40 - $120 per hour
...: $40 - $120/hour Required Skills domain-expertise client-relationship-management... ...analytical-thinking ai-content-evaluation About micro1 micro1 is a data lab that... ...recruiting agent sources and vets domain experts for our data platform that enables rapid...Part timeFor contractorsFreelanceRemote workmicro1
San Francisco, CA3 days ago- ...Create and evaluate prompts for AI in fine arts and design. About Turing: Turing is one of the world’s fastest-growing AI companies... ...Role Overview: We are seeking a highly qualified Art Domain Expert to evaluate and improve Large Language Models (LLMs). You...Contract workPart timeFor contractors
Turing
San Francisco, CAa month ago $120 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Domain Expert – Legal (Lexis+ Research) Type: Contract Compensation: $76–$120/hour Location: Remote Role Responsibilities...Remote jobContract workSummer work- ...Evaluate and improve AI responses about film and television accuracy. About Turing: Turing is one of the world’s fastest-growing... ...: We are seeking a highly qualified TV Shows & Movies Domain Expert to evaluate and improve Large Language Models (LLMs). You will...Contract workPart timeFor contractors
Turing
San Francisco, CAa month ago $105 per hour
..., and Jack Dorsey . Position: Engineering & Software Domain Expert Type: Contract Compensation: $65–$105/hour Location... ...Commitment: 40 hours/week Role Responsibilities Evaluate the quality of engineering knowledge work tasks and AI model...Remote jobContract workSummer work$50 - $120 per hour
...cybersecurity strategic planning scenario evaluation written communication feedback... ...AI recruiting agent sources and vets domain experts for our data platform that enables... ...Agency Expert – U.S. & Allied Government Role Type: Contractor Location:...Part timeFor contractorsRemote workmicro1
San Francisco, CA14 days ago$84 per hour
...Compensation: $84/hour Location: Remote Commitment: 10 hours/week Role Responsibilities Evaluate AI assistants on realistic science and engineering tasks. Write short realistic requests like a real user would type....Hourly payFull timeContract workFor contractorsSummer workRemote work$80 per hour
..., and Jack Dorsey . Position: STEM PhDs and Technical Domain Experts Type: Contract Compensation: $55–$80/hour Location... ...data by developing difficult problems in your domain. Evaluate and improve AI model performance through rigorous testing and...Remote jobContract workSummer work$150 per hour
...Jack Dorsey . Position: General Clinician (MD/DO) - HLS Expert Pool Type: Contract Compensation: $150/hour... ...checkable criteria for consistent model response grading. Evaluate clinical dialogues for accuracy safety completeness and appropriate...Full timeContract workSummer workRemote work$15 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation: $15/hour... ...months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres and assess quality...Contract workSummer workImmediate startRemote workFlexible hours$70 - $110 per hour
...weeks Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated sales conversations , product recommendations,... ..., order handling, and post-sale support. Provide expert feedback. Work independently and asynchronously to meet deadlines...Hourly payContract workSummer workImmediate startRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Government Evaluator - Domain Expert. Be the first to apply!
Related searches
- evaluator San Francisco, CA
- work from home web search evaluator San Francisco, CA
- ai evaluator San Francisco, CA
- education evaluator San Francisco, CA
- quality evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- technology expert San Francisco, CA
- subject matter expert San Francisco, CA
- guest service support expert San Francisco, CA
- fulfillment expert San Francisco, CA