Government Evaluator - Domain Expert
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Government / public administration Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs.
- Collaborate with subject matter experts to ensure consistency and quality.
- Work independently and asynchronously to meet deadlines while enhancing AI model performance.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Government / public administration.
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Master's or higher from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Government Evaluator - Domain Expert in San Francisco, CA vacancy
- Obsidian is seeking expert Evaluators in Biology/environmental science to review and assess AI-generated work products for accuracy and quality... ...feedback on documents and presentations, ensuring they meet domain-specific standards. A minimum of 5 years of relevant...SuggestedRemote jobHourly pay
- Obsidian is seeking experienced AI Safety Practitioners to evaluate safety, quality, and alignment of frontier AI models across complex... ..., self-harm, violence, cyber, biosecurity, and other sensitive domains, and collaborate with researchers and safety teams to #J-18808...Suggested
$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation...SuggestedContract workSummer workWork at officeRemote workMercor
San Francisco, CA3 days ago$80 - $120 per hour
.... Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour Location... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation...SuggestedContract workSummer workWork at officeRemote workMercor
San Francisco, CA27 days ago$80 - $120 per hour
...Position: Humanities / arts / culture Evaluator Type: Contract Compensation:... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual... .... Collaborate with subject matter experts to ensure consistency and quality....SuggestedContract workSummer workWork at officeRemote workMercor
San Francisco, CA3 days ago- We are seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex,... ..., self-harm, violence, cyber, biosecurity, and other sensitive domains. Apply and refine evaluation rubrics for RLHF, SFT, and AI safety...Worldwide
$80 - $120 per hour
...Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation:... ...AI-generated artifacts against domain-specific quality rubrics. Identify factual... .... Collaborate with subject matter experts to ensure consistency and domain relevance...Contract workSummer workWork at officeRemote workMercor
San Francisco, CA19 days ago$60 - $70 per hour
...60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance... ..., self-harm, violence, cyber, biosecurity, and other sensitive domains. Apply and refine evaluation rubrics for RLHF , SFT ,...Contract workSummer workRemote workMercor
San Francisco, CA18 days ago- ...Clinical Medicine Domain Expert Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise... ...actually practiced. Design challenging clinical tasks and evaluation sets, and help build medicine-specific skills and tools...Full timeContract workPart timeFreelanceLive inRelocationRelocation package
- Obsidian is seeking expert Evaluators in FP&A / corporate finance to assess AI-generated work products for accuracy and quality. This role entails deep expertise to grade outputs and provide structured feedback. Candidates should have at least 5 years of relevant experience...Remote jobHourly payWork at office
- Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across genres and rate it against detailed quality standards, working in Hindi and English. Bring a background in songwriting...
- About the roleWe're building a high-quality evaluation dataset for CNC manufacturing and are looking for experienced CNC machinists to help author and validate grading rubrics for CNC machining work. You'll bring real production-floor judgment to determine whether a machining...
- Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI... ...Duration: up to 6 months Commitment: flexible. Most experts work around 20 hours per week; there is no cap We consider all...Immediate startFlexible hours
$120 - $175 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: CNC Machining Expert Type: Contract Compensation: $120–$175/hour Location: Remote Role Responsibilities Contribute to text-only,...Contract workSummer workRemote workMercor
San Francisco, CA15 days ago$50 - $60 per hour
..., and Jack Dorsey . Position: Government & Public Policy Expert Type: Contract Compensation... ...requirements, RFP/solicitation, and evaluation criteria. Develop program and grants... ...to help us understand your sub-domain strengths. Qualified candidates will...Contract workSummer workLocal areaRemote workMercor
San Francisco, CA17 days ago$105 per hour
..., and Jack Dorsey . Position: Engineering & Software Domain Expert Type: Contract Compensation: $65–$105/hour Location... ...Commitment: 40 hours/week Role Responsibilities Evaluate the quality of engineering knowledge work tasks and AI model...Remote jobContract workSummer workMercor
San Francisco, CA5 days ago$120 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Domain Expert – Legal (Lexis+ Research) Type: Contract Compensation: $76–$120/hour Location: Remote Role Responsibilities...Remote jobContract workSummer workMercor
San Francisco, CA19 days ago$80 per hour
..., and Jack Dorsey . Position: STEM PhDs and Technical Domain Experts Type: Contract Compensation: $55–$80/hour Location... ...data by developing difficult problems in your domain. Evaluate and improve AI model performance through rigorous testing and...Remote jobContract workSummer workMercor
San Francisco, CA17 days ago$50 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Spanish (Spain) Audio Generalist Evaluator Expert Type: Contract Compensation: $50/hour Location: Remote Commitment: 10–20 hours/week Role...Contract workSummer workRemote workMercor
San Francisco, CA27 days ago$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour Location... ...and asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-Have ~5+ years of professional...Contract workSummer workRemote workMercor
San Francisco, CA9 days ago$70 - $110 per hour
...weeks Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated sales conversations , product recommendations,... ..., order handling, and post-sale support. Provide expert feedback. Work independently and asynchronously to meet deadlines...Hourly payContract workSummer workImmediate startRemote workMercor
San Francisco, CA3 days ago$15 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation: $15/hour... ...months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres and assess quality...Contract workSummer workImmediate startRemote workFlexible hoursMercor
San Francisco, CA15 days ago- ...Overview Mercor is partnering with a leading AI research organization to engage experienced sales engineers for a project focused on evaluating how well AI systems perform real-world technical sales work. Rather than producing deliverables yourself, you will define what...
$90 per hour
...Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid . Write structured rationales for every...Contract workSummer workLocal areaRemote workMercor
San Francisco, CA12 days ago- ...deliverables regarding common requests within the Real Estate domain. Diagnose and solve real issues in Real Estate to advance... ...Compensation & Legal Task-based payment upon first task approval. Experts qualify for hourly payment after first task completion....Hourly payContract workSummer workImmediate startRemote workFlexible hours
Mercor
San Francisco, CA3 days ago $150 per hour
...Summers , and Jack Dorsey . Position: Investment Banking Expert Type: Contract Compensation: $150–$220/hour... ...peers. Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Contract workSummer workRemote work- Cincinnatus LLC is hiring an experienced counsel-level lawyer to work with a leading AI lab's research and program management teams, shaping how frontier models reason about legal work. This is a full-time W-2 employment position with the opportunity to be placed at a leading...Full timeRelocationRelocation package
- CGS Federal (Contact Government Services) seeks a Senior eDiscovery Analytics Lead to apply legal experience in support of a large federal agency. Lead processing, analytics, and production tasks using Relativity, while coordinating with attorneys and clients to meet ESI...
$120 per hour
Prolific, located in San Francisco, is looking for Licensed Pharmacists to train and evaluate AI models. You will guide these systems by reviewing AI-generated pharmaceutical scenarios and providing your expertise. With competitive pay rates of up to $120 USD per hour...Remote jobHourly payWork from homeFlexible hours- A government services provider based in California is seeking a Senior Database Administrator to manage Microsoft SQL Server including administration, migration, and support of technologies such as Visual Studio and VMware. Candidates must have at least 5 years of SQL...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Government Evaluator - Domain Expert. Be the first to apply!
Related searches
- ai evaluator San Francisco, CA
- work from home web search evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- evaluator San Francisco, CA
- education evaluator San Francisco, CA
- quality evaluator San Francisco, CA
- subject matter expert San Francisco, CA
- fulfillment expert San Francisco, CA
- guest service support expert San Francisco, CA
- technology expert San Francisco, CA