Product Launch Expert - Evaluator
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Product launch / experiment readiness Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents , spreadsheets , and slide decks .
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines and ensure high-quality evaluations.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Product launch / experiment readiness .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the Product Launch Expert - Evaluator in New York, NY vacancy
$224.3k
General Information Job Title Expert Manager, Product Management & Innovation Job ID 107751 Work Areas Product Management &... ...Management experience, including assisting in the development and launch of software, enterprise solutions, services, mobile/web...SuggestedPermanent employmentFull timeWork at officeLocal areaHome office3 days per week- YO AI Labs is seeking a Product Management Expert contractor to shape AI-driven product workflows. You will design and evaluate gold-standard PM deliverables, including PRDs, launch memos, roadmap decks, and executive briefs, reflecting senior-level clarity and strategic...SuggestedRemote jobFor contractors
$80 - $120 per hour
...and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location... ..., structured written feedback to improve AI-generated work products. Apply deep subject-matter expertise to grade outputs for accuracy...SuggestedContract workSummer workWork at officeRemote workMercor
New York, NY11 days ago$80 - $120 per hour
...Dorsey . Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour... ...Workspace tools, especially Slides , to assess and refine work products. Qualifications Must-Have ~5+ years of relevant professional...SuggestedContract workSummer workWork at officeRemote workMercor
New York, NY11 days ago$80 - $150 per hour
...Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $... ...grading criteria for real-world digital product and UX deliverables . Score AI-... ...Work independently and asynchronously to evaluate and improve AI model performance . Qualifications...SuggestedContract workSummer workRemote workMercor
New York, NY7 days ago$50 - $70 per hour
...Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and... .... Work independently across common productivity tools with flexible hours . Qualifications...Contract workSummer workRemote workFlexible hoursMercor
New York, NY7 days ago- ...music producers and audio engineers to evaluate generative music AI models, in partnership... ..., prompt adherence, vocal quality, and production/mix quality Label songs by genre, structure... ...to 6 months Commitment: flexible. Most experts work around 20 hours per week; there is...Immediate startFlexible hours
- ...Role Overview Mercor is partnering with a leading AI research organization to engage experienced UI/UX and product designers for a project focused on evaluating how well AI systems perform real-world digital product design work. Rather than producing deliverables yourself...
- Indagare is seeking a Travel Desk Lead to launch, shape and scale a new product line within the Bookings Department. You will work to enrich the Self... ...and provide faster, turn-key planning for members seeking expert travel support. Reporting to the Sr. Director of...
$107.5k - $188.4k
Lead Technical Product Manager - UpToDate Growth At Wolters Kluwer, we combine deep clinical... ...growth for our suite of UpToDate Expert AI products. This role spans the full clinician... ...efforts, including messaging, positioning, and launch strategy for new AI capabilities. Data,...Full timeWork at officeRemote work- ...York, London, and Hong Kong, J.P. Morgan's PricingDirect (PD) evaluators serve clients globally by providing them with evaluated pricing... ...on the PricinDirect SPG evaluator team, you will combine deep product expertise along with strong quantitative and programming...Full time
- ...to engage experienced sales engineers for a project focused on evaluating how well AI systems perform real-world technical sales work.... ...engineering deliverables (technical discovery plans, tailored product demonstrations, proof-of-concept and technical evaluation plans...
$55k - $175k
Team: Product Management & AlliancesCity: New York CityState: NY Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history, we...Work at officeLocal areaRemote workWork from home3 days per week- ...is seeking experienced music producers and audio engineers to evaluate generative music AI models in collaboration with a leading AI... ...in Tamil and English. Ideal candidates have 2+ years in music production or audio engineering, with access to quality headphones or studio...
$150k - $200k
...Andreessen Horowitz to accelerate this mission. About The Role As a Solutions Engineer at EliseAI, you will be integral to our product launch and support processes. You will work closely with clients, support engineers, and customer success managers to ensure smooth product...Temporary workWork at officeLocal areaRelocation$177k - $260k
...filings, event transcripts, expert calls, news, trade journals,... ...expansion, with complementary product and content capabilities that... ...product marketing to build, launch, and optimize innovative AI-first... ...data analysis and SQL, can evaluate quality in AI-generated outputs...Local areaShift work$200k - $255k
...Altana is the network for trusted trade. Our AI-powered product network empowers governments and businesses to build a more resilient... ...global economy while keeping trade flowing. The Role: Product Expert PLM and ERP Altana's mission is to fix globalization. At...Full timeTemporary workWork experience placementRemote workFlexible hoursBYK-Chemie
New York, NY4 days ago$115k - $125k
...Product Expert Hex is growing fast; we are hiring a Product Expert to nurture and support customers to make them successful with Hex.... ...resume screening and fraud detection. These tools help our team evaluate applications and verify applicant information. All AI-...Work at officeFlexible hours2 days per weekHEX
New York, NY6 days ago$110k - $140k
Finance | Treasury Finance | Associate - Treasury Product Control & Analytics Expert | New YorkAbout ING: In Americas, ING’s Wholesale Banking division offers a broad range of innovative financial products and services to domestic and international corporate and institutional...Full timeWork at officeWork from home- ...research is looking for experienced Krita users for a flexible, project-based contract opportunity. This role allows you to earn while evaluating AI-generated content related to digital painting and concept art. Candidates should have at least 3 years of experience with...Contract workRemote workFlexible hours
Handshake
New York, NY3 days ago $90 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product Management Expert Type: Contract Compensation: $80–$90/hour Location: Remote Role Responsibilities Construct enterprise...Contract workSummer workRemote workMercor
New York, NY7 days ago- ...construction. You will be the technical authority for defensible LCA across our platform, coordinating with customers, verifiers, product, and engineering to ensure high-precision modeling. We seek 5-8 years of LCA experience, real project management across multiple workstreams...
- mthree in New York City is seeking a Production Support Analyst to join the Production Management team, supporting Client Portfolio Risk and Margin across desks, including weekend on-call. The role blends technical and business challenges with global follow-the-sun coverage...
$70 - $110 per hour
...weeks Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated sales strategies , quota plans, and training... ..., quota setting, and customer complaint resolution. Provide expert feedback on sales-performance analysis to improve AI model outputs...Hourly payContract workSummer workImmediate startRemote workMercor
New York, NY5 days ago$50 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) Type: Contract Compensation: $50/hour Location: San Francisco Bay Area Commitment:...Contract workSummer work10 hours per weekMercor
New York, NY11 days ago$150 per hour
...Summers , and Jack Dorsey . Position: Investment Banking Expert Type: Contract Compensation: $150–$220/hour... ...consistent. Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Contract workSummer workRemote workMercor
New York, NY7 days ago$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote workMercor
New York, NY11 days ago$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour Location... .... Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Contract workSummer workRemote workMercor
New York, NY12 days ago$90 per hour
...Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid . Write structured rationales for every...Contract workSummer workLocal areaRemote workMercor
New York, NY11 days ago$80 - $120 per hour
.... Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour Location... ...AI model performance . Collaborate with subject matter experts to ensure consistency and quality across datasets. Qualifications...Contract workSummer workWork at officeRemote workMercor
New York, NY7 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Product Launch Expert - Evaluator. Be the first to apply!
