Product Launch Expert - Evaluator
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Product launch / experiment readiness Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents , spreadsheets , and slide decks .
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines and ensure high-quality evaluations.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Product launch / experiment readiness .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Product Launch Expert - Evaluator in New York, NY vacancy
$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product launch / experiment readiness Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedContract workSummer workWork at officeRemote work$80 - $120 per hour
Mercor is seeking a Product launch / experiment readiness Evaluator to evaluate AI-generated artifacts against quality criteria. This role requires strong proficiency in Microsoft Office and Google Workspace, along with over 5 years of relevant experience. The position...SuggestedRemote jobHourly payWork at office$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedContract workSummer workWork at officeRemote workMercor
New York, NY8 days ago$224.3k
General Information Job Title Expert Manager, Product Management & Innovation Job ID 107751 Work Areas Product Management &... ...Management experience, including assisting in the development and launch of software, enterprise solutions, services, mobile/web...SuggestedPermanent employmentFull timeWork at officeLocal areaHome office3 days per week$80 - $150 per hour
...Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $... ...grading criteria for real-world digital product and UX deliverables . Score AI-... ...Work independently and asynchronously to evaluate and improve AI model performance . Qualifications...SuggestedContract workSummer workRemote workMercor
New York, NY2 days ago$107.5k - $188.4k
Lead Technical Product Manager - UpToDate Growth At Wolters Kluwer, we combine deep clinical... ...growth for our suite of UpToDate Expert AI products. This role spans the full clinician... ...efforts, including messaging, positioning, and launch strategy for new AI capabilities. Data,...Full timeWork at officeRemote work$55k - $175k
Team: Product Management & AlliancesCity: New York CityState: NY Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history, we...Work at officeLocal areaRemote workWork from home3 days per week- ...is seeking experienced music producers and audio engineers to evaluate generative music AI models in collaboration with a leading AI... ...in Tamil and English. Ideal candidates have 2+ years in music production or audio engineering, with access to quality headphones or studio...
$150k - $200k
...Andreessen Horowitz to accelerate this mission. About The Role As a Solutions Engineer at EliseAI, you will be integral to our product launch and support processes. You will work closely with clients, support engineers, and customer success managers to ensure smooth product...Temporary workWork at officeLocal areaRelocation$177k - $260k
...filings, event transcripts, expert calls, news, trade journals,... ...expansion, with complementary product and content capabilities that... ...product marketing to build, launch, and optimize innovative AI-first... ...data analysis and SQL, can evaluate quality in AI-generated outputs...Local areaShift work$110k - $140k
Finance | Treasury Finance | Associate - Treasury Product Control & Analytics Expert | New YorkAbout ING: In Americas, ING’s Wholesale Banking division offers a broad range of innovative financial products and services to domestic and international corporate and institutional...Full timeWork at officeWork from home$90 per hour
...Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid . Write structured rationales for every...Contract workSummer workLocal areaRemote workMercor
New York, NY1 day ago$150 per hour
...Summers , and Jack Dorsey . Position: Investment Banking Expert Type: Contract Compensation: $150–$220/hour... ...consistent. Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Contract workSummer workRemote workMercor
New York, NY5 days ago$50 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) Type: Contract Compensation: $50/hour Location: San Francisco Bay Area Commitment:...Contract workSummer work10 hours per weekMercor
New York, NY8 days ago$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour Location... .... Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Contract workSummer workRemote workMercor
New York, NY7 days ago$175k - $250k
...over $5 billion in combined revenue. The product-market fit is real, the problem is massive... ...landscape. As our subject matter expert for this domain, you will bring that judgment... ...Build proprietary benchmarks and datasets to evaluate models and AI agents against real-world...Full timeWork at officeFlexible hoursShift workTranslucent
New York, NY4 days ago$90 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product Management Expert Type: Contract Compensation: $80–$90/hour Location: Remote Role Responsibilities Construct enterprise...Contract workSummer workRemote workMercor
New York, NY2 days ago- ...retailers. We help design, merchandising, and product development teams move faster — from... ...Raspberry AI is looking for a Product Expert who bridges deep technical fluency with... ...cutting‑edge generative tools, run structured evaluations, deeply work in our product, translate...Immediate start
- Obsidian is seeking a Spanish (Mexico) Audio Generalist Evaluator Expert for a high-impact audio AI research project. The role focuses on transcription, annotation, and evaluation tasks to help train advanced language models. Candidates need to be fluent in Spanish (Mexico...Temporary work10 hours per week
- Handshake AI is seeking experienced CAD professionals with 2+ years of hands-on experience using SolidWorks and related CAD software, and professional proficiency in Mandarin Chinese, to support AI research through flexible, hourly contract work. This ongoing, project-based...Remote jobHourly payContract workFlexible hours
- ...research is looking for experienced Krita users for a flexible, project-based contract opportunity. This role allows you to earn while evaluating AI-generated content related to digital painting and concept art. Candidates should have at least 3 years of experience with...Remote jobContract workFlexible hours
- ...construction. You will be the technical authority for defensible LCA across our platform, coordinating with customers, verifiers, product, and engineering to ensure high-precision modeling. We seek 5-8 years of LCA experience, real project management across multiple workstreams...
- mthree in New York City is seeking a Production Support Analyst to join the Production Management team, supporting Client Portfolio Risk and Margin across desks, including weekend on-call. The role blends technical and business challenges with global follow-the-sun coverage...
$80 - $120 per hour
...Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour... ...expertise to grade outputs. Review and assess AI-generated work products for accuracy, rigor, and domain quality. Work independently...Contract workSummer workWork at officeRemote work$80 - $120 per hour
...Jack Dorsey . Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation: $80–$120/hour... ...teams to enhance the quality and accuracy of AI-generated work products . Work independently and asynchronously to meet deadlines...Contract workSummer workWork at officeRemote work$50 - $70 per hour
...Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and... .... Work independently across common productivity tools with flexible hours . Qualifications...Contract workSummer workRemote workFlexible hours$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/hour... ...factual, aesthetic, and presentation errors in AI-generated work products . Provide clear, structured written feedback to enhance AI...Contract workSummer workWork at officeRemote work- JPMorgan Chase & Co. is seeking a Product Control professional in New York to support daily P&L reporting, month-end close, and control remediation across trading desks and business units. The role partners with desks and finance management to deliver robust controls, detailed...
- ASK Consulting is seeking a detail-oriented CMS Specialist to enhance, promote, and launch websites. This hands-on role requires collaboration with the Senior Website Manager and cross-functional teams and involves executing website updates in Optimizely, conducting QA...Remote jobFull timeContract work
- Twelve in New York is seeking a Production Artist to ensure seamless project transitions from concept to production. The role involves preparing printer-ready files, optimizing artwork for print, and conducting detailed pre-press checks. Candidates should have over 3 years...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Product Launch Expert - Evaluator. Be the first to apply!
