Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Program Management Expert - Evaluator

$80 - $120 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Program management / implementation planning Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
  • Provide clear, structured written feedback to improve AI outputs.
  • Collaborate asynchronously to ensure high-quality evaluations.
  • Work independently to meet deadlines and enhance model performance.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Program management / implementation planning .
  • Native or professional fluency in English .
  • Highly proficient in Microsoft Office and Google Workspace , especially Slides .

Preferred

  • Advanced degree ( Master's or higher ) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 21 days ago
Similar jobs that could be interesting for youBased on the Program Management Expert - Evaluator in New York, NY vacancy
  • Department of Health and Social Services (DHSS) is seeking a Management Analyst III to serve as the Program Evaluator for the Tobacco Prevention and Control Program. The role involves conducting highly complex studies and analyzing statewide health surveillance data for... 
    Suggested
    Work at office

    Delaware LLC

    New York, NY
    2 days ago
  • $80 - $120 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    7 days ago
  • $70 - $110 per hour

     ...and Jack Dorsey . Position: Sales Managers Type: Contract Compensation:...  ...hours/week Role Responsibilities Evaluate AI-generated sales strategies , quota...  ...customer complaint resolution. Provide expert feedback on sales-performance analysis to... 
    Suggested
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    27 days ago
  • $70 per hour

     ...seeking an experienced PMO lead to train an AI language model on professional documents, spreadsheets, and slide decks. You will own program charters, RAID logs, and milestone tracking, ensuring accuracy and executive readiness. This fully remote, flexible role calls for... 
    Suggested
    Remote job
    Weekly pay
    Immediate start
    Flexible hours

    Ethos

    New York, NY
    3 days ago
  •  ...Intuit, Inc. is seeking a Program Design & Operations lead for the Expert Network within Expert Services. You will design and govern service delivery standards, own tax content and knowledge management, and ensure readiness across seasonal peaks. You'll work with Service... 
    Suggested

    Jobleads-US

    New York, NY
    3 days ago
  •  ...are essential for our clients' investment decisions and risk management strategies.Job Responsibilities:Generate daily valuations of interest...  ...and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits... 
    Daily paid
    Worldwide

    JP Morgan Chase

    New York, NY
    5 days ago
  • $75k - $80k

     ...Position Summary: The Vocational Evaluation Supervisor manages and supervises the Vocational Evaluation team, oversees the Individualized Vocational...  ...and educational achievement of the clients at the program site. What You'll Do Researches, develops, and implements... 

    Fedcap Rehabilitation Services

    New York, NY
    1 day ago
  • $224.3k

    General Information Job Title Expert Manager, Product Management & Innovation Job ID 107751 Work Areas Product Management...  ...dateBain & Company's comprehensive benefits and wellness program is designed to help employees achieve personal independence,... 
    Permanent employment
    Full time
    Work at office
    Local area
    Home office
    3 days per week

    Bain & Company

    New York, NY
    2 days ago
  • $207k - $300k

     ...knowledge and false assumptions.Build Legal evaluations by assessing industry benchmarks to...  ...recruiting and guiding Subject Matter Expert (SMEs), acting as the domain authority...  ...Strong technical capabilities, including programming proficiency, evaluating machine... 

    Google

    New York, NY
    1 day ago
  •  ...Kong, J.P. Morgan's PricingDirect (PD) evaluators  serve clients globally by providing them...  ...along with strong quantitative and programming skills to own end-to-end valuation outcomes...  ...to interact with clients, portfolio managers, traders, research, and sales. ~ Proven... 
    Full time

    JPMorgan Chase & Co.

    New York, NY
    12 days ago
  • $137.5k - $186k

     ...The Expert Network is one of Intuit's largest people organizations, sitting within Expert...  ...business line and season. As our Program Design & Operations lead, you'll own the...  ...and owning the tax content and knowledge management infrastructure that keeps our workforce... 
    Seasonal work
    Work at office

    Jobleads-US

    New York, NY
    3 days ago
  •  ...clients in the transportation sector to accelerate transformation efforts, make step-changes in major program delivery, and achieve leaps forward in areas such as asset management & maintenance, major projects, railway operations, strategic planning and advisory. Our work is... 
    Work at office
    Work from home
    Home office
    Flexible hours

    Network Rail Consulting

    New York, NY
    4 days ago
  • $100 - $120 per unit

     ...Jack Dorsey . Position: Baseball Fan Live MLB Game AI Evaluator (US) Type: Contract Compensation: $100$120 per...  ...team stats rules challenges schedules broadcasts highlights and expert-style analysis. Run the same question on two AI products side... 
    Full time
    Contract work
    Work experience placement
    Summer work
    Remote work

    Mercor

    New York, NY
    8 days ago
  • $80 - $150 per hour

     ...Larry Summers , and Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $80–$150/hour...  ...quickly on work. Work independently and asynchronously to evaluate and improve AI model performance . Qualifications Must-... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    4 days ago
  •  ...are hiring a senior pharmaceutical R&D domain expert to work directly with a leading AI lab's research and program management teams, improving how frontier AI models...  ...Design challenging pharmaceutical tasks and evaluation sets, and help build domain-specific skills... 
    Full time
    Contract work
    Part time
    Freelance
    Live in
    Relocation
    Relocation package

    Mercor

    New York, NY
    4 days ago
  • Design, run, and improve training programs from onboarding to workshops. Create content like e-learning modules, curricula, toolkits, and run feedback cycles. About you: 2+ years in L&D, training, or instructional design; LMS experience required. Fluent in English and... 
    Remote job
    Home office
    Flexible hours

    Orcrist

    New York, NY
    2 days ago
  • USmax Corporation is a remote, mission-driven provider of professional IT services specializing in federal healthcare program integrity. The role focuses on reviewing CMS guidance, developing educational materials, and advising CPI stakeholders on program integrity initiatives... 
    Remote job

    Remote Jobs

    New York, NY
    2 days ago
  •  ...of Vanta's GTM-facing GRC Subject Matter Experts, you will be a highly visible, customer-...  ...for representing Vanta's Trust Management Platform to prospects and customers, as...  ...internal and external stakeholders on GRC programs, including program foundation/scaling strategies... 
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours

    Vanta

    New York, NY
    3 days ago
  • $500 per month

     ...Larry Summers , and Jack Dorsey . Position: CUDA Engineering Expert Type: Contract Compensation: $500/hour Location: Remote Role Responsibilities...  ...background. Write and modify C++17 , Python , and GPU programming code. Apply expertise in CUDA , HIP , and shader programming... 
    Remote job
    Contract work
    Summer work

    mercor

    New York, NY
    4 days ago
  • We are seeking skilled and experienced Audio Speech Evaluators Experts to assess speech quality and conversational performance through natural, unscripted interactions with an AI bot, in accordance with established evaluation guidelines. The ideal candidates will demonstrate... 

    Innodata India

    New York, NY
    3 days ago
  • $80 - $120 per hour

     ..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    15 days ago
  • $80 - $160 per hour

     ...Summers , and Jack Dorsey . Position: Operations / Program Management Experts Type: Contract Compensation: $80–$160/hour Location...  ...structured feedback to improve document standards and evaluation processes. Collaborate with teams to enhance project... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    6 days ago
  • $14 per hour

     ...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract Compensation: $14/hour Location...  ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    13 days ago
  • $39 per hour

     ...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - English (US) Type: Contract Compensation: $39/hour...  ...months Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output for lyrics, voice generation, and other... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    13 days ago
  • $80 - $120 per hour

     ...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Clinical / biomedical / pharma Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    4 days ago
  • $90 per hour

     ...Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid . Write structured rationales for every... 
    Contract work
    Summer work
    Local area
    Remote work

    Mercor

    New York, NY
    7 days ago
  • $150 per hour

     ...Larry Summers , and Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation: $150/hour Location:...  ...Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses to challenging medical problems... 
    Contract work
    Summer work
    Immediate start
    Remote work
    Flexible hours

    Mercor

    New York, NY
    7 days ago
  • $50 per hour

     ...Summers , and Jack Dorsey . Position: English Language and Literature Expert Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated English text across various use cases... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    14 days ago
  • $15 per hour

     ...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation: $15/hour...  ...months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate it against... 
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    a month ago
  • $70 - $110 per hour

     ...weeks Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated sales conversations , product recommendations,...  ..., order handling, and post-sale support. Provide expert feedback. Work independently and asynchronously to meet deadlines... 
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    New York, NY
    24 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Program Management Expert - Evaluator. Be the first to apply!