Program Management Expert - Evaluator
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Program management / implementation planning Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI outputs.
- Collaborate asynchronously to ensure high-quality evaluations.
- Work independently to meet deadlines and enhance model performance.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Program management / implementation planning .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher ) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Program Management Expert - Evaluator in New York, NY vacancy
$80 - $120 per hour
..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...SuggestedContract workSummer workWork at officeRemote work$90k - $150k
Monograph in New York, NY is seeking a Global Equity Compensation Administrator to manage the operations of equity compensation programs using the Morgan Stanley/E*TRADE platform. The ideal candidate should have at least 5 years of experience in stock plan administration...Suggested$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI...SuggestedContract workSummer workWork at officeRemote workFlexible hoursMercor
New York, NY2 days ago$70 - $110 per hour
...and Jack Dorsey . Position: Sales Managers Type: Contract Compensation:... ...hours/week Role Responsibilities Evaluate AI-generated sales strategies , quota... ...customer complaint resolution. Provide expert feedback on sales-performance analysis to...SuggestedHourly payContract workSummer workImmediate startRemote work- Intuit is seeking a Program Design & Operations lead for the Expert Network COE in New York to design and govern the service delivery standard work, tax content, and knowledge management infrastructure that supports a diverse, seasonally-driven workforce. You will own...Suggested
- ...our clients globally by providing them evaluated pricing on over two million fixed income... ...financial markets knowledge with programming skills to enhance valuation accuracy, efficiency... ...to interact with clients, portfolio managers, traders, research, and salesStrong...
- ...clients globally by providing them with evaluated pricing on over three million fixed... ...expertise along with strong quantitative and programming skills to own end-to-end valuation... ...skills to interact with clients, portfolio managers, traders, research, and sales. ~...Full time
JPMorgan Chase & Co.
New York, NY15 hours ago - ...research is looking for experienced Krita users for a flexible, project-based contract opportunity. This role allows you to earn while evaluating AI-generated content related to digital painting and concept art. Candidates should have at least 3 years of experience with...Contract workRemote workFlexible hours
Handshake
New York, NY3 days ago $224.3k
General Information Job Title Expert Manager, Product Management & Innovation Job ID 107751 Work Areas Product Management... ...dateBain & Company's comprehensive benefits and wellness program is designed to help employees achieve personal independence,...Permanent employmentFull timeWork at officeLocal areaHome office3 days per week$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...Contract workSummer workWork at officeRemote workMercor
New York, NY6 days ago$50 per hour
...Jack Dorsey . Position: Spanish (Mexico) Audio Generalist Evaluator Expert Type: Contract Compensation: $50/hour Location:... ...thinking skills. Ability to work independently and manage time effectively. Native or near-native fluency in Spanish...Contract workSummer workRemote workMercor
New York, NY6 days ago$90 per hour
...Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid . Write structured rationales for every...Contract workSummer workLocal areaRemote workMercor
New York, NY6 days ago$50 - $70 per hour
...Larry Summers , and Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation: $50–$70/hour Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for quality...Contract workSummer workRemote workFlexible hoursMercor
New York, NY2 days ago$150 per hour
...Jack Dorsey . Position: Utilisation Management / Case Management leader (RN/Physician-... ...discharge planning, and care coordination. Evaluate AI-generated medical necessity... ...determinations. Manage the physician advisor program to support complex UM cases, peer-to-...Contract workSummer workRemote workNight shiftMercor
New York, NY2 days ago$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote workMercor
New York, NY6 days ago$80 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $80–$150/hour... ...quickly on work. Work independently and asynchronously to evaluate and improve AI model performance . Qualifications Must-...Contract workSummer workRemote workMercor
New York, NY2 days ago$50 per hour
..., and Jack Dorsey . Position: Hindi Audio Generalist Evaluator Expert (San Francisco Bay Area) Type: Contract Compensation:... ...critical thinking skills. Ability to work independently and manage time effectively. Native or near-native fluency in Hindi and...Contract workSummer work10 hours per weekMercor
New York, NY6 days ago- ...Job Description Job Description GPU Programming Expert - Remote Job Type: Contractor Location: Remote Job Overview We are seeking experienced GPU Programmers / Software Engineers to design and optimize GPU-based tasks for AI and LLM applications. You will...For contractorsRemote work
YO AI Labs
New York, NY2 days ago - ...hiring a senior insurance and actuarial domain expert to work directly with a leading AI lab's research and program management teams, improving how frontier AI models... ...depth: Design challenging insurance tasks and evaluation sets, and help build domain-specific skills...Full timeContract workPart timeFreelanceLive inRelocationRelocation package
$70 per hour
...We're looking for nonprofit program and philanthropy professionals... ...+ years in nonprofit program management, philanthropy, or community-based... ...organizations to create, evaluate, and refine AI-generated documents... ...for funders and boards Expert-level document, spreadsheet,...Immediate startRemote workFlexible hours$60k - $175k
...corporate and investment banking, securities brokerage, and wealth management. Citi Bank Retail Mortgage provides home lending services via... ...01(k); life, accident, and disability insurance; and wellness programs. Citi also offers paid time off packages, including planned...Full timeLocal area- Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards. Start date: immediate. Duration: up to...Hourly payImmediate start
$100 - $150 per hour
...structured sales methodologies. Exceptionally strong written communication skills. Detail-oriented and comfortable with peer-reviewed judgment. Preferred Prior experience with AI training, evaluation, or human-data projects. #J-18808-Ljbffr United States Digital Space LLCSummer workRemote work- Mercor is seeking experienced musicians to evaluate generative music AI models, collaborating with a leading AI lab. You will assess AI-generated music and lyrics in Telugu and English, applying detailed quality standards across genres. Responsibilities include comparing...Part timeImmediate start
- ...is partnering with a leading AI research organization to engage experienced UI/UX and product designers for a project focused on evaluating how well AI systems perform real-world digital product design work. Rather than producing deliverables yourself, you will define...
- Obsidian is seeking a Spanish (Mexico) Audio Generalist Evaluator Expert for a high-impact audio AI research project. The role focuses on transcription, annotation, and evaluation tasks to help train advanced language models. Candidates need to be fluent in Spanish (Mexico...Temporary work10 hours per week
- Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI... ...Duration: up to 6 months Commitment: flexible. Most experts work around 20 hours per week; there is no cap We consider all...Immediate startFlexible hours
- ...Overview We are hiring a senior legal domain expert to work directly with a leading AI lab's research and program management teams, improving how frontier AI models... ...domain depth: Design challenging legal tasks and evaluation sets, and help build legal-specific skills...Remote jobFull timeContract workPart timeFreelanceInternshipLive inRelocationRelocation package
$80k - $110k
Position Overview Job Title: Operations Expert Corporate Title: Analyst- Assistant Vice... ...with a combined $70bn assets under management (AUM). Operations is responsible for managing... ...resources, matching gift, and volunteer programs What You’ll Do Provide end‑to‑end...Work at officeWork from home- Join a growing network of industry experts supporting AI research and development. Overview We\'re building a select group of experienced healthcare professionals to help evaluate and improve how AI systems understand and reason about healthcare topics. You\'ll bring your...Contract workPart timeRemote work10 hours per weekFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Program Management Expert - Evaluator. Be the first to apply!
Related searches
- sql expert New York, NY
- subject matter expert New York, NY
- fulfillment expert New York, NY
- guest service support expert New York, NY
- technology expert New York, NY
- clinical evaluator New York, NY
- ai evaluator New York, NY
- work from home web search evaluator New York, NY
- social media evaluator New York, NY
- program evaluator New York, NY