Business Operations Expert - Evaluator
$60 - $80 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting)
Type: Contract
Compensation: $60–$80/hour
Location: Remote
Role Responsibilities
- Sign an NDA before receiving any materials.
- Solve one realistic, domain-specific task using the source files provided.
- Review five model-generated outputs for that task. Rank them 1–5 with no ties, score each 0–100, and write evidence-based rationales citing specific parts of the output.
- Provide structured feedback on the task itself and on the study design.
- Work independently to complete the task within a short turnaround window.
Qualifications
Must-Have
- 5+ years of hands-on professional experience in Admin , Marketing , Human Resources , or Accounting .
- Currently or recently practicing to judge work as a working professional would.
- Ability to write a clear, specific, evidence-grounded rationale for a judgment.
- Reliable within a short turnaround window.
Compensation & Legal
- Hourly contractor
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the Business Operations Expert - Evaluator in San Francisco, CA vacancy
- Obsidian is looking for expert Evaluators in Finance operations/audit support to review AI-generated work products for accuracy and quality. This remote hourly position requires a minimum of 5 years in finance and fluency in English. Your role will involve evaluating outputs...OperationsRemote jobHourly payWork at office
- Obsidian is seeking expert Evaluators in Operations / inventory / capacity planning to review AI-generated documents, spreadsheets, and slide decks for accuracy and domain quality. The role is remote and paid hourly, inviting professionals who can apply deep subject-matter...OperationsRemote jobHourly pay
$60 - $100 per hour
Business & Sales Operations Domain Expert Job Type: Full-Time, W-2 Location: Bay Area, California — Hybrid Schedule: 40 hours/week Compensation: $60-$... ...research and program management teams developing and evaluating next-generation generative AI systems. This role is designed...OperationsFull timeLive inRelocationRelocation package$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI...OperationsContract workSummer workWork at officeRemote workMercor
San Francisco, CA10 days ago- We're seeking an organized and proactive AI Enablement & Adoption Coordinator to support the day-to-day operations of enterprise AI learning and adoption programs. This role will help drive AI proficiency across the organization by supporting learning initiatives, coordinating...OperationsHourly payFreelance
- ...escalations across internal teams.Act as the internal voice of the customer, gathering feedback to influence product roadmaps and operations.Partner with CSMs and AEs to identify account risks, drive renewals, and uncover expansion opportunities.Collaborate across...OperationsFull timeRemote workVisa sponsorshipWork visa
$37.56 - $45.9 per hour
...we’re on a journey to do our best. Helping the customers and businesses we serve to make better and smarter financial decisions and enabling... ..., procedures and support systems- Understanding of banking operations, product knowledge, sales, new business development, customer...OperationsFull timeWork experience placementLocal area$77k - $202k
...Description & SummaryAt PwC, our people in operations consulting specialise in providing... ...processes, improve productivity, and drive business performance.As an operations consulting... ...collaborating closely with team members. We evaluate these factors thoughtfully to establish...OperationsFull timeH1b$86.7k - $170.9k
...innovation, marketing, commerce, sales, and service. We are a team of strategists, data scientists, operators, creatives, designers, engineers, and architects. Our team balances business strategy, technology, creativity, and ongoing managed services to solve the biggest...OperationsLocal areaVisa sponsorship- ...greater growth, enhance competitiveness, implement operational improvements, reduce cost, deliver sustainable 360... ...aspects of an organization’s reinvention.You Are:An R&D expert with an in-depth understanding of how business, technology, and operations intersect. You’ve got...OperationsFull timeLive inWork at officeLocal area
- ...across strategy, consulting, technology, operations, Song and Industry X with our deep... ...ideas to bring to our clients. You are an expert at executing on strategic plans. You consider... ...Support responses to RFPs and support business development efforts Mentor junior members...OperationsFull timeLive inWork at officeLocal area
$133k - $166k
...Description About the Role: A career as a Business Immigration Associate at Fragomen gives... ...learn from the industry’s leading experts. Our unwavering dedication to excellence... ...to mitigate risk and ensure regulatory, operational and client compliance. Other duties as required...OperationsWork at officeLocal areaRemote work3 days per week100 Fragomen, Del Rey, Bernsen & Loewy, LLP
San Francisco, CA3 days ago- ...re looking for a hands-on contractor to support the day-to-day operations of our AI learning and adoption programs — from administering... ..., coordinating communications, and tracking engagement across business units.Adoption Reporting: Help track and report on learning progress...OperationsFor contractorsWork at officeShift work
eTeam Inc.
San Francisco, CA2 days ago $77k - $202k
Industry/SectorConsumerSpecialismCorporate and Business StrategyManagement LevelSenior... ...identify growth opportunities and optimize operations- Providing consulting services across various... ...closely with team members. We evaluate these factors thoughtfully to establish...OperationsFull timeH1b- ...stakeholder engagement, and sustainable business transformation throughout the program... ...impact assessments across business and operational teams.Analyze assessment findings and present... ...for the following business purposes: evaluating qualifications and eligibility for...OperationsWork at officeLocal areaImmediate start
Pride Global
San Francisco, CA3 days ago $168.75k - $200k
...ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform... ...the right level of context - security, operational and business - to build the first of its... .... Serve as a trusted advisor during evaluations, competitive situations, and executive...OperationsWork at officeImmediate startRemote workFlexible hours- ...highest-risk part of the program — the role must solve it.Build and operate a change champion network across HQ, stores, DCs, and call... ...leadership for enterprise-wide distribution.Bachelor's degree in Business, Human Resources, Communications, Information Technology, or...OperationsContract workLocal areaImmediate start
Pyramid Corporation
San Francisco, CA2 days ago - ...Franchise Business Consultant – Multi-Unit Restaurant Operations Ready to take your restaurant operations experience to the next level? We’re looking for an experienced Franchise Business Consultant (FBC) to serve as a trusted coach and business partner to franchisees...OperationsWork at officeFlexible hoursNight shiftWeekend work
Self Opportunity
San Francisco, CA3 days ago $112.6k - $212.7k
...Capgemini Invent - Sr. Consultant - Life Sciences, Business Insights Atlanta, Chicago, New York, San Francisco At Capgemini Invent,... ...offerings in AI/Data Science, Digital Customer Analytics, and Operational Analytics. People Development Help grow the team aiding in initiatives...OperationsFull timeWork at officeLocal areaCapgemini
San Francisco, CA3 days ago- ...we're on a journey to do our best. Helping the customers and businesses we serve to make better and smarter financial decisions and enabling... ..., procedures and support systems- Understanding of banking operations, product knowledge, sales, new business development, customer...OperationsTemporary workWork experience placement
- ...Business Consultant We are a proud work-from-office company. If you're ready to work on-site in a dynamic, global company, we'd love... ...helps thousands of businesses streamline and grow their operations with custom strategies that benefit both employers and employees...OperationsContract workWork at officeShift work
- ...collection, analysis, and reporting of key business metrics, ensuring accurate data flows... ...analytics with business goals. Streamline operations through data optimization. Identify... ...and deploy cutting‑edge analytics tools. Evaluate and implement new software or platforms...OperationsWork experience placement
- ...that maximizes aircraft uptime and operational efficiency for the world’s most... ...About the Role We are seeking a Business Consultant in USA with a passion for delivering... ..., pain points, and success criteria Evaluate multiple solution approaches and...Operations
Veryon
San Francisco, CA3 days ago $63.8k - $205.8k
...areas of expertise - Aftermarket, Supply Chain/Manufacturing Operations, Freight and Logistics, Data/AI - to play a pivotal role in addressing... ...while maintaining a process‑oriented approach and sound business judgment. Establish strong credibility and cultivate...OperationsWork experience placementLocal area- ...performance management. The role works cross-functionally with business leaders, technology teams, and data stakeholders to establish... ...embed standardized portfolio management practices into daily operations, coaching for adoption and driving accountability without direct...Operations
$130.25k - $152k
...initiatives by assessing market trends, evaluating organizational capabilities, and... ...Have 7+ years of project management, business analysis, change management, and/or management... ...portfolio management, process improvement, and operations Career history that demonstrates...OperationsFull timeLive inWork at officeLocal areaRelocation$80 - $120 per hour
...and Jack Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour... ...high-quality assessments. Collaborate with subject matter experts to ensure consistency and relevance across datasets. Qualifications...OperationsContract workSummer workWork at officeRemote work$120k - $135k
...including all aspects of client matters; from creation of matter set-up, managing the engagement's success and then coordination with operations and finance up through client billing and invoicing. A successful candidate will be able to apply his/her knowledge of...OperationsWork experience placementRemote workFlexible hours- ...and grow as a team. About the Role Decagon is looking for a Business Value Consultant to build and scale our value engineering function... ...Even better if you have Experience in SaaS, AI/ML, customer operations, or contact center ecosystems. Background in consulting (e.g....OperationsFull timeWork at office
$95k - $160k
...shape how a leading active asset manager operates. Participants will rotate through... ...Associates will work on problems with real business consequences: mapping and redesigning manual... ..., building data-driven business cases, evaluating and strategically applying AI and automation...OperationsRotational programPermanent employmentTemporary workWork at officeRemote workWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Business Operations Expert - Evaluator. Be the first to apply!
Related searches
- new business consultant San Francisco, CA
- business system consultant San Francisco, CA
- business continuity specialist San Francisco, CA
- business consultant San Francisco, CA
- business operations specialist San Francisco, CA
- business banking specialist San Francisco, CA
- business office specialist San Francisco, CA
- management advisor San Francisco, CA
- new business specialist San Francisco, CA
- management consultant San Francisco, CA