Business Operations Expert - Evaluator
$60 - $80 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting)
Type: Contract
Compensation: $60–$80/hour
Location: Remote
Role Responsibilities
- Sign an NDA before receiving any materials.
- Solve one realistic, domain-specific task using the source files provided.
- Review five model-generated outputs for that task. Rank them 1–5 with no ties, score each 0–100, and write evidence-based rationales citing specific parts of the output.
- Provide structured feedback on the task itself and on the study design.
- Work independently to complete the task within a short turnaround window.
Qualifications
Must-Have
- 5+ years of hands-on professional experience in Admin , Marketing , Human Resources , or Accounting .
- Currently or recently practicing to judge work as a working professional would.
- Ability to write a clear, specific, evidence-grounded rationale for a judgment.
- Reliable within a short turnaround window.
Compensation & Legal
- Hourly contractor
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 27 days ago
Similar jobs that could be interesting for youBased on the Business Operations Expert - Evaluator in San Francisco, CA vacancy
- Obsidian is hiring expert Evaluators in Healthcare operations for a remote, hourly engagement. You will review AI-generated work products for accuracy, rigor, and domain quality, leveraging your extensive subject-matter expertise in the field. The ideal candidate has over...OperationsRemote jobHourly payWork at office
$150 per hour
...Review AI responses to improve business decision-making strategies.... ...50/hr depending on internal evaluation and location. About... ...invites Business Consulting Experts to join projects that fine-tune... ...in consulting, strategy, or operations will help shape how the next...OperationsPart timeFor contractorsTuring
San Francisco, CA3 days ago$500 per month
...powerpoint microsoft word business documentation financial... ...prompt engineering ai evaluation feedback documentation... ...models and evaluating AI agents. Experts contribute their diverse... ...driving projects in strategy, operations, sales, marketing, finance,...OperationsPart timeFor contractorsWork at officeRemote workmicro1
San Francisco, CA3 days ago- ...AI models. # Overview We are hiring a senior business and sales operations domain expert to work directly with a leading AI lab's research and... ...domain depth: Design challenging operations tasks and evaluation sets, and help build domain-specific skills and tools...OperationsFull timeContract workPart timeFreelanceLive inRelocationRelocation package
Mercor
San Francisco, CA3 days ago - ...Job Description Job Description Business Document Expert - Remote Job Type: Contractor Location... ...to support an AI training and evaluation project. The role involves creating realistic... ...tools . Background in strategy, operations, finance, consulting, sales,...OperationsRemote jobFor contractors
YO AI Labs
San Francisco, CA4 days ago $120 - $175 per hour
...Larry Summers , and Jack Dorsey . Position: CNC Machining Expert Type: Contract Compensation: $120–$175/hour... ...machining experience. ~ Strong production judgment to assess safe operations on real machines. ~ Written English fluency for text-based...OperationsContract workSummer workRemote workMercor
San Francisco, CA7 days ago$163k
Requisition ID # 175125 Job Category: Business Operations / Strategy Job Level: Individual Contributor Business Unit: Energy Delivery Work Type: Hybrid Job Location: Oakland; Pleasanton Position Summary Business Analysts are responsible for research, data analysis, budgeting...OperationsWork experience placementWork at officeRemote work2 days per week1 day per week- ...greater growth, enhance competitiveness, implement operational improvements, reduce cost, deliver sustainable 360... ...aspects of an organization’s reinvention.You Are:An R&D expert with an in-depth understanding of how business, technology, and operations intersect. You’ve got...OperationsFull timeLive inWork at officeLocal area
Accenture
San Francisco, CA5 days ago $78k - $105k
...we’re on a journey to do our best. Helping the customers and businesses we serve to make better and smarter financial decisions and enabling... ..., procedures and support systems- Understanding of banking operations, product knowledge, sales, new business development, customer...OperationsFull timeWork experience placementLocal areaUS Bank
San Francisco, CA2 days ago$120k - $135k
...including all aspects of client matters; from creation of matter set-up, managing the engagement's success and then coordination with operations and finance up through client billing and invoicing.A successful candidate will be able to apply his/her knowledge of litigation...OperationsFull timeWork experience placementRemote workFlexible hoursControl Risks
San Francisco, CA1 day ago$136k - $217k
...matters - to you, to your community, and to the world. Progress starts with you.Job DescriptionJob SummaryThe Business Consultant, Business Strategy & Operations, serves as a seasoned individual contributor responsible for solving complex operational problems with...OperationsFull timeWork experience placementWork at officeLocal areaVisa
San Francisco, CA2 days ago$110.7k - $218.3k
...complexity and accelerate value creation. Deloitte’s Enterprise Operations & Risk practice is seeking an SAP Commodity Solutions Senior Consultant to support commodity-intensive clients through business and technology transformation. This role focuses on helping organizations...OperationsContract workLocal areaVisa sponsorshipDeloitte
San Francisco, CA1 day ago$95.6k - $188.4k
...impact on our clients' success. You’ll work alongside talented professionals reimagining and re-engineering operations and processes that are critical to businesses. Your contributions can help clients improve financial performance, accelerate new digital ventures, and...OperationsLocal areaDeloitte
San Francisco, CA3 days ago$102k - $147k
...Contract Management / Supplier and Vendor Evaluations / Purchase Order Management amongst... ...50%About UsSlalom is a fiercely human business and technology consulting company that... ...public sector organizations to improve operations, drive growth, and create value. At Slalom...OperationsContract workTemporary workLocal areaSlalom
San Francisco, CA1 day ago$77k - $202k
Industry/SectorConsumerSpecialismCorporate and Business StrategyManagement LevelSenior... ...identify growth opportunities and optimize operations- Providing consulting services across various... ...closely with team members. We evaluate these factors thoughtfully to establish...OperationsFull timeH1bPwC
San Francisco, CA3 days ago$168.75k - $200k
...ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform... ...the right level of context - security, operational and business - to build the first of its... .... Serve as a trusted advisor during evaluations, competitive situations, and executive...OperationsWork at officeImmediate startRemote workFlexible hoursMoveworks
San Francisco, CA1 day ago$37.56 - $45.9 per hour
...we're on a journey to do our best. Helping the customers and businesses we serve to make better and smarter financial decisions and enabling... ..., procedures and support systems - Understanding of banking operations, product knowledge, sales, new business development, customer...OperationsWork experience placement- ...Business Sales Consultant, Hcm About Us Vensure Employer Solutions is the largest privately held organization in the HR technology... ...Vensure helps thousands of businesses streamline and grow their operations with custom strategies that benefit both employers and...OperationsContract workWork at officeShift work
- ...Business Consultant We are a proud work-from-office company. If you're ready to work on-site in a dynamic, global company, we'd love... ...helps thousands of businesses streamline and grow their operations with custom strategies that benefit both employers and employees...OperationsContract workWork at officeShift work
$112.6k - $212.7k
Capgemini Invent - Sr. Consultant - Life Sciences, Business Insights Atlanta, Chicago, New York, San Francisco At Capgemini Invent, we... ...offerings in AI/Data Science, Digital Customer Analytics, and Operational Analytics. People Development Help grow the team aiding in...OperationsFull timeWork at officeLocal area$116.2k - $229.1k
...efforts that help clients improve connectivity, data quality, and operational performance across HR and payroll ecosystems. In this role,... .... You will help deliver scalable solutions that align business requirements with integration and data management best practices...OperationsLocal areaVisa sponsorshipDeloitte
San Francisco, CA2 days ago$105.4k - $207.8k
...managed services that simplify complexity, we enable our clients to operate with resilience, grow with confidence, and proactively manage... ...owners, and technical teams to gather requirements, translate business needs into technical solutions, and manage scope, timelines,...OperationsLocal areaVisa sponsorshipDeloitte
San Francisco, CA2 days ago$60k - $120k
...Business Operations Associate Role We are looking for a talented leader to oversee business operations at Hive. As a Business Operations Associate, you will be assisting the executive team with a variety of key activities, including improving existing processes and...OperationsTemporary workWork experience placementHive
San Francisco, CA3 days ago- ...A Curie.Bios portfolio company is seeking a highly organized, entrepreneurial, and hands-on Fractional Business Operations Consultant to build and manage the companys non-scientific operating infrastructure. This is a highly leveraged role for an individual who enjoys...Operations
Curie
San Francisco, CA4 days ago - ...for this role on behalf of our client. Take ownership of a core operational area end to end at a growing company, spanning sales, customer... ...We're Looking For At least 1 year in an operations role (business operations, revenue operations, go-to-market operations or similar...OperationsFull timeWork at officeWork from homeFlexible hours
Healthcare Technology Corp
San Francisco, CA3 days ago $139k - $260k
...partnering with clients to optimize treasury operations, improve working capital, and implement... ...about the career areas and lines of business at wellsfargojobs.com.In this role, you... ...as a treasury management subject matter expert, mentor team members, and support strategic...OperationsFull timeWork experience placementWells Fargo
San Francisco, CA4 days ago$120k - $150k
...Mach9 Business Operations AssociateMach9 is hiring two Business Operations Associates to own key processes, solve new operating problems, and help the company scale.This is a doer's role. You'll often do something by hand several times, understand exactly how it works,...OperationsWork at officeMach9 Robotics Inc
San Francisco, CA12 hours ago- ...comprehensive support to child care providers operating out of their homes as well as in the... ...and meet the demands of their business, while also helping parents in need of childcare... ...to build and automate with AI tools ~ Expert MS Excel / Google Sheets skills - candidate...OperationsWork at officeFlexible hours
Wonderschool
San Francisco, CA3 days ago $105.4k - $207.8k
...Cyber team understands the unique challenges and opportunities businesses face in cybersecurity. Join our team to deliver powerful... ...managed services that simplify complexity, we enable our clients to operate with resilience, grow with confidence, and proactively manage...OperationsLocal areaVisa sponsorshipDeloitte
San Francisco, CA2 days ago- ...About Plenful Plenful is on a mission to transform healthcare operations from the inside out. Fresh off our $50M Series B and backed by... ...our growing team. About the Role Plenful is hiring a Business Operations Associate to help build the internal systems and processes...OperationsFull timeWork at officeRemote workFlexible hours2 days per week
Plenful
San Francisco, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Business Operations Expert - Evaluator. Be the first to apply!
Related searches
- business operations associate San Francisco, CA
- business process consultant San Francisco, CA
- change management consultant San Francisco, CA
- business system consultant San Francisco, CA
- business banking specialist San Francisco, CA
- dental practice management consultant San Francisco, CA
- program management consultant San Francisco, CA
- business solutions consultant San Francisco, CA
- business consultant San Francisco, CA
- business office specialist San Francisco, CA