Operations Evaluator - Domain Expert [Remote]
$80 - $120 per hourMercor
San Francisco, CA
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Operations / inventory / capacity planning Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise in Operations , inventory , and capacity planning .
- Work independently and asynchronously to meet deadlines and ensure high-quality evaluations.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Operations , inventory , and capacity planning .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides (Google Slides / PowerPoint).
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the Operations Evaluator - Domain Expert [Remote] in San Francisco, CA vacancy
$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour... ...Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation...SuggestedContract workSummer workWork at officeRemote workMercor
San Francisco, CA6 days ago- ...Responsibilities We are looking for an exceptional Staff Domain Expert, Customer Support to join our growing AI Business Solutions... ...agents and apps — translating deep knowledge of CX, service operations, and support workflows into production-grade AI agents and apps...OperationsRemote workFlexible hours
- ...generate high-quality data, evaluations, and reinforcement learning environments... ...-critical workflows. By operating on both sides, Turing closes... ...to contribute senior domain expertise to data curation for... ...frameworks, and serve as an expert advisor for client teams reviewing...OperationsContract workFor contractorsFreelanceRemote workFlexible hours
Turing
San Francisco, CA1 day ago - Mercor, headquartered in San Francisco, is seeking STEM PhDs and Technical Domain Experts to join a cutting-edge AI project. This remote position requires advanced degrees in relevant fields and emphasizes strong communication skills and attention to detail. The role involves...SuggestedRemote job
- Mercor is looking for a Humanities / arts / culture Evaluator who will evaluate AI-generated artifacts against specific quality rubrics. You will identify errors and provide feedback to enhance AI model outputs. The ideal candidate has over 5 years of experience in the...SuggestedRemote jobWork at officeFlexible hours
- Mercor is seeking a Training / onboarding / L&D Evaluator to enhance AI evaluation processes. Based in San Francisco, you'll evaluate AI... ...generated artifacts, provide structured feedback, and work with experts to ensure quality. The role requires 5+ years of relevant...Remote jobWork at officeFlexible hours
- Mercor in San Francisco is hiring a mid-level Healthcare Manager - Domain Expert for a full-time remote role. The position focuses on creating deliverables for medical and health services and contributing to AI research. Candidates should have 4+ years of relevant experience...Remote jobFull time
$80 - $120 per hour
...Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80–$120/hour... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...Remote jobContract workSummer workWork at officeMercor
San Francisco, CA6 days ago$80 - $120 per hour
...and Jack Dorsey . Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $80–$120/hour... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...Remote jobContract workSummer workWork at officeMercor
San Francisco, CA4 days ago$80 - $120 per hour
Mercor, based in San Francisco, is seeking a Healthcare operations Evaluator to evaluate AI-generated artifacts against quality standards and provide feedback. Candidates must have more than 5 years of experience in Healthcare operations and fluency in English. This contract...OperationsRemote jobContract workWork at office$80 - $120 per hour
Mercor is seeking an Operations / Inventory / Capacity Planning Evaluator to join their remote team. The role encompasses evaluating AI-generated artifacts, identifying errors, and providing structured feedback, drawing on deep expertise in operations. Candidates should...OperationsRemote jobHourly payWork at office- Mercor is seeking a Data quality / CRM operations Evaluator to assess AI-generated artifacts and provide feedback for improvement. This role requires exceptional attention to detail and a minimum of 5 years of experience in the related field. Successful candidates will...OperationsRemote jobContract workWork at officeFlexible hours
$80 - $120 per hour
Mercor is seeking an Operations / inventory / capacity planning Evaluator to join their team remotely. The role involves evaluating AI-generated content against quality standards and providing structured feedback. Ideal candidates will have over 5 years of experience in...OperationsRemote jobContract workWork at office$80 - $120 per hour
Mercor in San Francisco is looking for a Customer Success / Support Operations Evaluator to assess AI-generated outputs against quality standards. Candidates must have over 5 years of relevant experience and fluency in English. Proficiency in Microsoft Office and Google...OperationsRemote jobContract workWork at office$80 - $120 per hour
Mercor is seeking a Healthcare Operations Evaluator to assess AI-generated outputs based on quality standards. You'll leverage your deep expertise in healthcare operations and provide structured feedback to enhance AI performance. Successful candidates will have at least...OperationsRemote jobContract workWork at office$72.94k - $137.95k
Job Class: 0823 Evaluator Salary Range: $72,943 - $137,945 Calendar: Full-Time, School-Term Responsibilities Provide support in communicating... ..., data and/or productivity applications such as DnA, Test Operations Management System (TOMS), Microsoft Word, Excel, PowerPoint,...OperationsFull timeWork at office$1,150 - $1,450 per month
...Dorsey . Position: Telecommunications Expert Type: Contract Compensation: $1... ...Role Responsibilities Review and evaluate AI-generated outputs related to network architecture design , telecom operations workflows , and communications technology...OperationsHourly payContract workSummer workRemote workMercor
San Francisco, CA12 days ago- ...interface. The Mapping City/Country Expert will be responsible for high-impact work... ...Create guideline documents to be used by operators with country-specific insights. Provide... ...operational errors at scale. Evaluate import data from the Import Engineering...OperationsLocal area
TSMG
San Francisco, CA4 days ago - ...Benefits: 401(k) 401(k) matching Bonus based on performance Expert SailPoint Engineer Needed 15 Plus Years Experience---Remote Job... ...Create and maintain client knowledge articles, Standard Operating Procedure (SOPs), and scripts to restore normal operations Monitor...OperationsRemote work
DELTASOFT SOLUTIONS
San Francisco, CA3 days ago $129k
...Position Summary PG&E is seeking a strategic professional with strong engineering, regulatory, or operations experience to join Electric Risk and Compliance as an Expert Program Manager – Insights & Intelligence. In this role, you will help leaders stay ahead of...OperationsWork at officeFlexible hoursPG&E Corporation
Daly City, CA3 days ago$277.8k
...Product Development Data Sciences (PDD). Operating across the Science of Medicines and Operations... ...medicines. The Opportunity: The Expert Imaging Lead, Cardiovascular, Renal &... ...agility that extends beyond the technical domain You demonstrate respect for cultural differences...OperationsLocal areaRelocation packageGenentech
South San Francisco, CA4 days ago$126k
...Requisition ID # 171692 Job Category: Business Operations / Strategy; Maintenance / Construction /... ...(EII) Team as an Incident Investigator, Expert. The EII team is responsible for... ...(20-day report) and Apparent Cause Evaluations (ACEs), including identifying corrective...OperationsWork experience placementWork at officeRemote workFlexible hoursPG&E Corporation
San Francisco, CA2 days ago$70 - $95 per hour
Obsidian is seeking a RevOps Expert based in the United States to partner with leading AI labs for better agent evaluations in revenue operations. The role requires building long-horizon tasks that mirror existing work and are graded against deterministic rubrics. With...Operations$161k - $188k
...Senior Subject Matter Expert - Senior Service Planner DB E.C.O. North America offers... ...a focus on sustainability, safety, and operational excellence, they strive to enhance the customer... ...planning. Lead the design and evaluation of theoretical and operational timetables...OperationsFull timeTemporary workLocal areaFlexible hoursNight shiftDB E.C.O. North America
San Francisco, CA3 days ago$122k
...compliance-related risks for Electric Operations. This role maintains... ...across operational and regulatory domains. The incumbent... ...cross-functional stakeholders to evaluate compliance risks, support mitigation... ...serves as a subject matter expert on regulatory compliance...OperationsPG&E
Oakland, CA3 days ago$126k
...Woodland; Yuba City Summary: As an Expert on the Compliance Strategic Initiatives... ...Strategy and other leaders to evaluate compliance maturity performance, perform... ...and/or to identify, manage, and mitigate operational risk. The selected candidate must...OperationsWork experience placementFlexible hoursPG&E Corporation
Brisbane, CA1 day ago$140k - $189k
...The Solutions Architect, Expert holds primary responsibility... ...within a specific technology domain related to SCADA and Protection... ...technology architects and associated operations and functional areas to... ...Assessment and Technology Oversight: Evaluates health of the technology...OperationsWork at officeRemote work2 days per week1 day per weekPG&E
Oakland, CA3 days ago$120 per hour
...Jack Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic,...OperationsRemote jobContract workSummer workWork at officeMercor
San Francisco, CA4 days ago$130k - $148k
...contracts for compliance issues and resolve discrepancies. Evaluate the effectiveness of compliance programs and procedures. Conduct... ...of federal, state, and local laws impacting gas or electric operations within the utility industry. Ability to prioritize workload...OperationsContract workWork at officeLocal areaAxelon
Daly City, CA4 days ago$20 per hour
...sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement,... ...Strong attention to detail Background or experience in domains requiring structured analytical thinking Preferred Prior...Remote jobContract workPart timeSummer workMercor
San Francisco, CA17 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Operations Evaluator - Domain Expert [Remote]. Be the first to apply!
Related searches
- quality evaluator San Francisco, CA
- work from home web search evaluator San Francisco, CA
- evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- fulfillment expert San Francisco, CA
- technology expert San Francisco, CA
- sql expert San Francisco, CA
- guest service support expert San Francisco, CA
- subject matter expert San Francisco, CA
- vice president technical operations San Francisco, CA