Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Program Management Expert - Evaluator

$80 - $120 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Program management / implementation planning Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
  • Provide clear, structured written feedback to improve AI-generated work products.
  • Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
  • Work independently and asynchronously to ensure high-quality evaluations.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Program management / implementation planning.
  • Native or professional fluency in English .
  • Highly proficient in Microsoft Office and Google Workspace , especially Slides .

Preferred

  • Advanced degree (Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 11 days ago
Similar jobs that could be interesting for youBased on the Program Management Expert - Evaluator in San Francisco, CA vacancy
  • $80 - $120 per hour

     ...Larry Summers , and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour...  ...outputs . Collaborate with subject matter experts to ensure consistency and quality. Work independently... 
    Suggested
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    14 days ago
  • $129k

     ...Requisition ID # 174054 Job Category: Project / Program Management Job Level: Individual Contributor Business Unit: Energy Delivery Work Type: Hybrid Job Location: Oakland Department Overview Electric Transmission & Distribution ensures... 
    Suggested
    Contract work

    Pacific Gas And Electric Company

    Oakland, CA
    14 days ago
  • $224.3k

    General Information Job Title Expert Manager, Product Management & Innovation Job ID 107751 Work Areas Product Management...  ...dateBain & Company's comprehensive benefits and wellness program is designed to help employees achieve personal independence,... 
    Suggested
    Permanent employment
    Full time
    Work at office
    Local area
    Home office
    3 days per week

    Bain & Company

    San Francisco, CA
    4 days ago
  • $500 per month

     ...Summers , and Jack Dorsey . Position: CUDA Engineering Expert Type: Contract Compensation: $500/hour Location:...  ...background. Write and modify C++17 , Python , and GPU programming code. Apply expertise in CUDA , HIP , and shader programming... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    3 days ago
  •  ...Clinical Medicine Domain Expert Join a leading AI lab's cutting-edge GenAI team...  ...with a leading AI lab's research and program management teams, improving how frontier AI models...  ...Design challenging clinical tasks and evaluation sets, and help build medicine-specific... 
    Suggested
    Full time
    Contract work
    Part time
    Freelance
    Live in
    Relocation
    Relocation package

    Mercor

    San Francisco, CA
    4 days ago
  • Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI...  ...Duration: up to 6 months Commitment: flexible. Most experts work around 20 hours per week; there is no cap We consider all... 
    Immediate start
    Flexible hours

    Obsidian

    San Francisco, CA
    2 days ago
  • Obsidian is seeking expert Evaluators in FP&A / corporate finance to assess AI-generated work products for accuracy and quality. This role entails deep expertise to grade outputs and provide structured feedback. Candidates should have at least 5 years of relevant experience... 
    Remote job
    Hourly pay
    Work at office

    Obsidian

    San Francisco, CA
    10 hours ago
  • Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across genres and rate it against detailed quality standards, working in Hindi and English. Bring a background in songwriting... 

    Obsidian

    San Francisco, CA
    2 days ago
  • $80 - $120 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80-$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor Inc

    San Francisco, CA
    3 days ago
  • About the roleWe're building a high-quality evaluation dataset for CNC manufacturing and are looking for experienced CNC machinists to help author and validate grading rubrics for CNC machining work. You'll bring real production-floor judgment to determine whether a machining... 

    Obsidian

    San Francisco, CA
    10 hours ago
  • Obsidian is seeking experienced AI Safety Practitioners to evaluate safety, quality, and alignment of frontier AI models across complex policy-sensitive topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured... 

    Obsidian

    San Francisco, CA
    2 days ago
  • Obsidian is seeking expert Evaluators in Biology/environmental science to review and assess AI-generated work products for accuracy and quality. In this remote, hourly role, you will leverage your expertise to provide feedback on documents and presentations, ensuring they... 
    Remote job
    Hourly pay

    Obsidian

    San Francisco, CA
    1 day ago
  • $120 - $175 per hour

     ...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: CNC Machining Expert Type: Contract Compensation: $120–$175/hour Location: Remote Role Responsibilities Contribute to text-only,... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    17 days ago
  • Peregrine Technologies, based in San Francisco, is seeking a Public Sector Compliance Manager to own and scale our government contractor compliance program. You will collaborate with Legal, People Ops, Finance, Contracts, and GRC to ensure robust controls across audits,... 
    Contract work
    For contractors

    Mosaic.tech

    San Francisco, CA
    3 days ago
  • Benefit Cosmetics is seeking a Senior Manager, Total Rewards in San Francisco to shape and deliver compensation, benefits, recognition, and rewards programs. You will collaborate with People, Finance, Legal, Payroll, and HRIS to keep programs competitive, equitable, scalable... 

    Benefit Cosmetics

    San Francisco, CA
    3 days ago
  •  ...Overview Mercor is partnering with a leading AI research organization to engage experienced sales engineers for a project focused on evaluating how well AI systems perform real-world technical sales work. Rather than producing deliverables yourself, you will define what... 

    Mercor

    San Francisco, CA
    3 days ago
  • $293.5k

    General Information Job Title Expert Senior Manager, AI Engineering Job ID 104335 Work...  ...research, model experimentation, and evaluation design to production system...  ...leading complex, multi-stack generative AI programs from conception through productionStrong... 
    Permanent employment
    Full time
    Apprenticeship
    Work at office
    Local area
    Work from home
    Home office
    3 days per week

    Bain & Company

    San Francisco, CA
    1 day ago
  • Mercor is seeking expert Evaluators in Procurement / vendor management to review AI-generated documents, spreadsheets, and slide decks for accuracy and quality. You will apply deep domain knowledge to grade outputs. This is a remote, hourly engagement. The ideal candidate... 
    Remote job
    Hourly pay
    Work at office

    Mercor

    San Francisco, CA
    2 days ago
  •  ...Operations Lead for Generative AI in San Francisco. You will own growth programs, optimize the supplier onboarding funnel, and partner with Engineering, Operations, and GTM to ensure on-time delivery of expert projects. You will build scalable analytics, forecasts, and... 

    Scale

    San Francisco, CA
    3 days ago
  •  ...Platform Lead to own the buildout of our in-house expert network. This includes creating our sourcing, management, training, product, and metrics for all people-...  ...solve those problems Empathy. We want our expert program to be the best in the world, and that requires us... 

    Halluminate

    San Francisco, CA
    2 days ago
  • $261k - $290k

     ...calls for a single, dedicated owner to realize its full potential.We are creating a dedicated Director role as a GitHub Subject Matter Expert (SME) — the accountable owner who turns that momentum into results. GitHub is the tip of the spear for our Zero Legacy and Azure... 
    Temporary work
    Local area

    Slalom

    San Francisco, CA
    4 days ago
  • About the role We are hiring expert Evaluators in Procurement / vendor management to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs... 
    Hourly pay
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    2 days ago
  • YO AI Labs seeks a Logistics & Supply Chain Management Expert for a remote contract role. You will review and annotate logistics documents, identify best practices, and suggest workflow improvements based on real-world experience. Strong English communication and attention... 
    Remote job
    Contract work

    YO AI Labs

    San Francisco, CA
    1 day ago
  • Role Overview Mercor is seeking senior wealth management and asset management professionals to build evaluation tasks for AI systems operating in Fortune 500 enterprise investment and advisory contexts. The workflows are calibrated to the portfolio complexity, regulatory... 

    Obsidian

    San Francisco, CA
    1 day ago
  •  ...Job Description Job Description GPU Programming Expert - Remote Job Type: Contractor Location: Remote Job Overview We are seeking experienced GPU Programmers / Software Engineers to design and optimize GPU-based tasks for AI and LLM applications. You will... 
    Remote job
    For contractors

    YO AI Labs

    San Francisco, CA
    10 days ago
  • $70 - $110 per hour

     ...weeks Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated sales conversations , product recommendations,...  ..., order handling, and post-sale support. Provide expert feedback. Work independently and asynchronously to meet deadlines... 
    Hourly pay
    Contract work
    Summer work
    Immediate start
    Remote work

    Mercor

    San Francisco, CA
    5 days ago
  • $80 - $120 per hour

     ..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    11 days ago
  • $50 per hour

     ...Jack Dorsey . Position: Spanish (Spain) Audio Generalist Evaluator Expert Type: Contract Compensation: $50/hour Location:...  ...thinking skills. Ability to work independently and manage time effectively. Native or near-native fluency in Spanish... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    29 days ago
  • $80 - $120 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    San Francisco, CA
    5 days ago
  • $100 - $150 per hour

     ...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation:...  ...asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-...  ...outbound prospecting, discovery, deal management, and structured sales methodologies. ~... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    11 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Program Management Expert - Evaluator. Be the first to apply!