Product Launch Expert - Evaluator
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Product launch / experiment readiness Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines while ensuring domain quality.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Product launch / experiment readiness .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 24 days ago
Similar jobs that could be interesting for youBased on the Product Launch Expert - Evaluator in San Francisco, CA vacancy
$80 - $120 per hour
.... Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour Location... ..., structured written feedback to improve AI-generated work products. Apply deep subject-matter expertise to grade outputs for accuracy...SuggestedContract workSummer workWork at officeRemote workMercor
San Francisco, CA2 days ago$120 - $175 per hour
...Larry Summers , and Jack Dorsey . Position: CNC Machining Expert Type: Contract Compensation: $120–$175/hour... ...explain pass/fail outcomes with detailed reasoning. Apply real production-floor judgment to determine the approval or rejection of machining...SuggestedContract workSummer workRemote workMercor
San Francisco, CA2 days ago$50 - $70 per hour
...Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and... .... Work independently across common productivity tools with flexible hours . Qualifications...SuggestedContract workSummer workRemote workFlexible hoursMercor
San Francisco, CA2 days ago- ...TULSA-PRO Clinical Product Expert Our mission is to profoundly change the standard of care by creating a tomorrow where clinicians can confidently ablate tissue with precision; a tomorrow where patients have access to safe and effective treatment options, so they can...SuggestedNight shift
$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour Location... ...and asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-Have ~5+ years of professional...SuggestedContract workSummer workRemote workMercor
San Francisco, CA15 days ago- ...Description Job Description Job Title: Product Management Expert Role Type: Contractor Location:... ...management expertise to create, evaluate, and benchmark high-quality PM deliverables... ...-standard deliverables across PRDs, launch memos, roadmap presentations,...Remote jobFor contractors
$80 - $120 per hour
...Program management / implementation planning Evaluator Type: Contract Compensation:... ...errors in AI-generated work products . Provide clear, structured written... .... Collaborate with subject matter experts to ensure consistency and quality. Work...Contract workSummer workWork at officeRemote work$90 per hour
...Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid . Write structured rationales for every...Contract workSummer workLocal areaRemote workMercor
San Francisco, CA2 days ago$100 - $150 per hour
..., Larry Summers , and Jack Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a software engineering context...Contract workSummer workWork at officeRemote workMercor
San Francisco, CA2 days ago$100 - $150 per hour
...Dorsey . Position: Sales Engineering Expert Type: Contract Compensation:... ...translating customer requirements into product solutions, delivering tailored demos, handling... ..., supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands...Contract workSummer workRemote work$60 per hour
...'Angelo , Larry Summers , and Jack Dorsey . Position: Product Reviewer – AI Web Application Specifications Type: Contract... ...AI-generated product specifications for web applications. Evaluate if product requests are realistic, complete, and unambiguous....Remote jobContract workSummer work$150 per hour
...Summers , and Jack Dorsey . Position: Investment Banking Expert Type: Contract Compensation: $150–$220/hour... ...peers. Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Contract workSummer workRemote work$60 - $70 per hour
...: AI Safety Practitioner Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality. Review content involving misinformation...Contract workSummer workRemote work$60k - $74k
...right mattress matters, and so does the right career. Our Sleep Experts® are at the heart of what we do: helping customers find their... ...by being a trusted sleep authority and offering best-in-class products. Experts will execute Mattress Firm selling programs with the...Local areaMattress Firm
Daly City, CA4 days ago$132k
...technology enablement. Position Summary The Expert Compute, Operating Systems(OS), and Hardware Product Owner will guide cross-functional Agile teams in... ...shared understanding, vendor strategies, and evaluations. ~ Own BPD planning and support alignment...Work at officeLocal areaRemote work1 day per weekPacific Gas And Electric Company
Oakland, CA2 days ago$60k - $72k
...right mattress matters, and so does the right career. Our Sleep Experts® are at the heart of what we do: helping customers find their... ...by being a trusted sleep authority and offering best-in-class products. Experts will execute Mattress Firm selling programs with the...Local areaMattress Firm
San Francisco, CA1 day ago- Obsidian is hiring expert Evaluators in Healthcare operations for a remote, hourly engagement. You will review AI-generated work products for accuracy, rigor, and domain quality, leveraging your extensive subject-matter expertise in the field. The ideal candidate has over...Remote jobHourly payWork at office
- ...Maps interface. The Mapping City/Country Expert will be responsible for high‑impact work... ..., data gaps, and provide insights to the product Leverage local familiarity with regional... ...and identify operational errors at scale Evaluate import data from the Import Engineering team...Local area
TSMG Holding
San Francisco, CA3 days ago - ...professional to serve as our Senior Safety Domain Expert for Veeva Falcon. In this role, you will... ...End-to-End Workflow Guidance: Advise product and engineering teams on the detailed... ...& Verification: Actively review, evaluate, and verify AI-driven platform outputs across...Work at officeLocal areaWork from homeShift work
Veeva Systems
San Francisco, CA2 days ago $100 - $120 per hour
...Position: Software & Firmware Engineering Experts Type: Contract Compensation:... ...involving real physical systems. Review and evaluate embedded firmware , FPGA/RTL designs... ...as the responsible engineer for production hardware-connected software or firmware....Contract workSummer workRemote workMercor
San Francisco, CA2 days ago$90k - $200k
...assistant on small/medium projects for our Delay and/or Quantum experts involved in domestic and international arbitration and... ...the tasks/workload of the project team and reviewing their work product to ensure quality standards are met Reviewing documents on varied...Kroll
San Francisco, CA1 day ago- ...s changing lives every day! JOB SUMMARY The Sales and Service Expert (SSE) delivers an outstanding and well-rounded sales and service... ...compelling approach of offering membership, fitness and retail products and services. The SSE builds relationships and translates the...Work experience placementWork at officeLocal area
$150 per hour
...Jack Dorsey . Position: Senior Design Expert - Paid AI Design Research Study Type:... ...to capture expert design thinking. Evaluate design quality, critique, and shipping standards... ...Senior-level design experience in product, UX, brand, or adjacent craft disciplines...Contract workSummer workRemote workMercor
San Francisco, CA2 days ago$50 - $60 per hour
...Position: Government & Public Policy Expert Type: Contract Compensation:... ...officials. Build and review regulatory work products. Include proposed and final rule text,... ...Develop requirements, RFP/solicitation, and evaluation criteria. Develop program and grants...Contract workSummer workLocal areaRemote workMercor
San Francisco, CA2 days ago$45 - $55 per hour
...single high monitor or a dual-monitor setup. Work independently to meet project deadlines and deliver high-quality mechanical and product designs . Collaborate asynchronously with teams to ensure design accuracy and consistency. Provide feedback on design...Contract workSummer workRemote workMercor
San Francisco, CA2 days ago- ...reviewed end to end by a second Bengali expert, and experienced annotators take on that... ...annotation, labeling, grading, or bilingual evaluation for training datasets ~... ...correction or post-editing ~ Document production: typesetting, copy-editing, proofreading...Temporary work
Neon
San Francisco, CA21 days ago $70.72k
...we’re UNSTOPPABLE for our employees!Job Overview Sr Mobile Expert are our most capable experts with a passion for delivering best... ...all customer needs from research to resolution, as well as new products and a product roadmap built specifically for these locations. This...Hourly payFull timeTemporary workPart timeWork experience placementLocal areaFlexible hours$50 per hour
...Position: Personalized Life Assistant Expert Type: Contract Compensation:... ...hours/week Role Responsibilities Evaluate the effectiveness of AI systems in handling... ...outputs across domains like food, health, productivity, careers, and learning. Provide...Contract workSummer workRemote workMercor
San Francisco, CA2 days ago$80 - $150 per unit
...0 per task Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated content in search systems... .... Qualifications Must-Have Experience shipping production search systems. Ownership of relevance or retrieval on systems...Contract workSummer workRemote workMercor
San Francisco, CA21 days ago$80 - $150 per hour
...Responsibilities Develop and optimize agentic search systems for production environments. Own relevance and retrieval processes to... ...and asynchronously to enhance search quality and evaluation. Qualifications Must-Have Experience with production...Contract workSummer workRemote workMercor
San Francisco, CA15 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Product Launch Expert - Evaluator. Be the first to apply!
