Product Launch Expert - Evaluator
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Product launch / experiment readiness Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines while ensuring domain quality.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Product launch / experiment readiness .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 9 days ago
Similar jobs that could be interesting for youBased on the Product Launch Expert - Evaluator in New York, NY vacancy
$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product launch / experiment readiness Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedContract workSummer workWork at officeRemote work$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product launch / experiment readiness Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedContract workSummer workWork at officeRemote work$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedContract workSummer workWork at officeRemote workFlexible hoursMercor
New York, NY2 days ago$224.3k
General Information Job Title Expert Manager, Product Management & Innovation Job ID 107751 Work Areas Product Management &... ...Management experience, including assisting in the development and launch of software, enterprise solutions, services, mobile/web...SuggestedPermanent employmentFull timeWork at officeLocal areaHome office3 days per week- ...music producers and audio engineers to evaluate generative music AI models, in partnership... ..., prompt adherence, vocal quality, and production/mix quality Label songs by genre, structure... ...to 6 months Commitment: flexible. Most experts work around 20 hours per week; there is...SuggestedImmediate startFlexible hours
$50 - $70 per hour
...Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and... .... Work independently across common productivity tools with flexible hours . Qualifications...Contract workSummer workRemote workFlexible hoursMercor
New York, NY2 days ago- ...Role Overview Mercor is partnering with a leading AI research organization to engage experienced UI/UX and product designers for a project focused on evaluating how well AI systems perform real-world digital product design work. Rather than producing deliverables yourself...
- About the role We are hiring expert Evaluators in Real estate / hospitality / events to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade...Hourly payWork at officeRemote work
- Indagare is seeking a Travel Desk Lead to launch, shape and scale a new product line within the Bookings Department. You will work to enrich the Self... ...and provide faster, turn-key planning for members seeking expert travel support. Reporting to the Sr. Director of...
$107.5k - $188.4k
Lead Technical Product Manager - UpToDate Growth At Wolters Kluwer, we combine deep clinical... ...growth for our suite of UpToDate Expert AI products. This role spans the full clinician... ...efforts, including messaging, positioning, and launch strategy for new AI capabilities. Data,...Full timeWork at officeRemote work- ...York, London, and Hong Kong, J.P. Morgan's PricingDirect (PD) evaluators serve clients globally by providing them with evaluated pricing... ...the PricingDirect SPG evaluator team, you will combine deep product expertise along with strong quantitative and programming skills...Full time
Socket.dev
New York, NY6 hours ago - ...to engage experienced sales engineers for a project focused on evaluating how well AI systems perform real-world technical sales work.... ...engineering deliverables (technical discovery plans, tailored product demonstrations, proof-of-concept and technical evaluation plans...
$55k - $175k
Team: Product Management & AlliancesCity: New York CityState: NY Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history, we...Work at officeLocal areaRemote workWork from home3 days per week- ...is seeking experienced music producers and audio engineers to evaluate generative music AI models in collaboration with a leading AI... ...in Tamil and English. Ideal candidates have 2+ years in music production or audio engineering, with access to quality headphones or studio...
$150k - $200k
...Andreessen Horowitz to accelerate this mission. About The Role As a Solutions Engineer at EliseAI, you will be integral to our product launch and support processes. You will work closely with clients, support engineers, and customer success managers to ensure smooth product...Temporary workWork at officeLocal areaRelocation$177k - $260k
...filings, event transcripts, expert calls, news, trade journals,... ...expansion, with complementary product and content capabilities that... ...product marketing to build, launch, and optimize innovative AI-first... ...data analysis and SQL, can evaluate quality in AI-generated outputs...Local areaShift work$110k - $140k
Finance | Treasury Finance | Associate - Treasury Product Control & Analytics Expert | New YorkAbout ING: In Americas, ING’s Wholesale Banking division offers a broad range of innovative financial products and services to domestic and international corporate and institutional...Full timeWork at officeWork from home- ...research is looking for experienced Krita users for a flexible, project-based contract opportunity. This role allows you to earn while evaluating AI-generated content related to digital painting and concept art. Candidates should have at least 3 years of experience with...Contract workRemote workFlexible hours
Handshake
New York, NY3 days ago $200k - $255k
...Altana is the network for trusted trade. Our AI-powered product network empowers governments and businesses to build a more resilient... ...global economy while keeping trade flowing. The Role: Product Expert PLM and ERP Altana's mission is to fix globalization. At...Full timeTemporary workWork experience placementRemote workFlexible hoursBYK-Chemie
New York, NY4 days ago$115k - $125k
About the Role Hex is growing fast; we are hiring a Product Expert to nurture and support customers to make them successful with Hex. Our... ...screening and fraud detection. These tools help our team evaluate applications and verify applicant information. All AI-generated...Work at officeFlexible hours2 days per week- ...construction. You will be the technical authority for defensible LCA across our platform, coordinating with customers, verifiers, product, and engineering to ensure high-precision modeling. We seek 5-8 years of LCA experience, real project management across multiple workstreams...
- Mercor seeks a pharma commercial forecasting expert for a paid pilot to create and critique rubrics that... ...programs. Remote from the US, you will evaluate uptake models and ensure forecasts are defensible across launches. You will work approximately 10-20 hours over a...Remote work
- mthree in New York City is seeking a Production Support Analyst to join the Production Management team, supporting Client Portfolio Risk and Margin across desks, including weekend on-call. The role blends technical and business challenges with global follow-the-sun coverage...
- Tailored Brands, Inc. is seeking a Product & Costing Associate to work with the Product Development team in New York, NY. You will bring expertise in men’s apparel, fabrics, design principles, and the lifecycle from design to sourcing to life. The ideal candidate is highly...
$110k - $135k
.... Own the standards: EN15804+A2, ISO14040/14044, ISO14025, the PCRs. Translate clause‑level requirements into modeling decisions, product behavior, and customer‑facing guidance. Keep the methodology current as the standards evolve. Manage technical relationships: Work...FreelanceWork at officeRelocation- Weekday AI is seeking an experienced Agency Brand Design Expert to evaluate AI and human-created brand design work. You will define grading criteria and provide rigorous, justified feedback based on professional standards. Remote, independent contractor engagement with...Remote jobFor contractorsFlexible hoursWeekday work
- Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI... ...Duration: up to 6 months Commitment: flexible. Most experts work around 20 hours per week; there is no cap Compensation: this...Hourly payImmediate startFlexible hours
- Obsidian is seeking a Spanish (Mexico) Audio Generalist Evaluator Expert for a high-impact audio AI research project. The role focuses on transcription, annotation, and evaluation tasks to help train advanced language models. Candidates need to be fluent in Spanish (Mexico...Temporary work10 hours per week
- Mercor is seeking experienced musicians to evaluate generative music AI models, collaborating with a leading AI lab. You will assess AI-generated music and lyrics in Telugu and English, applying detailed quality standards across genres. Responsibilities include comparing...Part timeImmediate start
- Join a growing network of industry experts supporting AI research and development. Overview We\'re building a select group of experienced healthcare professionals to help evaluate and improve how AI systems understand and reason about healthcare topics. You\'ll bring your...Contract workPart timeRemote work10 hours per weekFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Product Launch Expert - Evaluator. Be the first to apply!
