Program Management Expert - Evaluator
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Program management / implementation planning Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI outputs.
- Collaborate asynchronously to ensure high-quality evaluations.
- Work independently to meet deadlines and enhance model performance.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Program management / implementation planning .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher ) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 16 days ago
Similar jobs that could be interesting for youBased on the Program Management Expert - Evaluator in New York, NY vacancy
- Department of Health and Social Services (DHSS) is seeking a Management Analyst III to serve as the Program Evaluator for the Tobacco Prevention and Control Program. The role involves conducting highly complex studies and analyzing statewide health surveillance data for...SuggestedWork at office
$70 per hour
...seeking an experienced PMO lead to train an AI language model on professional documents, spreadsheets, and slide decks. You will own program charters, RAID logs, and milestone tracking, ensuring accuracy and executive readiness. This fully remote, flexible role calls for...SuggestedRemote jobWeekly payImmediate startFlexible hours$80 - $120 per hour
..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated...SuggestedContract workSummer workWork at officeRemote work- Intuit is seeking a Program Design & Operations lead for the Expert Network COE in New York to design and govern the service delivery standard work, tax content, and knowledge management infrastructure that supports a diverse, seasonally-driven workforce. You will own...Suggested
$70 per hour
...AI lab to find experienced implementation program directors who can help train their latest... ...implementation initiatives to create, evaluate, and refine AI-generated documents, spreadsheets... ...under executive and stakeholder scrutiny Expert-level document, spreadsheet, and slide...SuggestedImmediate startRemote workFlexible hours- ...Intuit, Inc. is seeking a Program Design & Operations lead for the Expert Network within Expert Services. You will design and govern service delivery standards, own tax content and knowledge management, and ensure readiness across seasonal peaks. You'll work with Service...
- Mercor is seeking experienced Medical and Health Services Managers to evaluate and improve AI-generated healthcare operations content and workflows... ...comparing AI outputs for regulatory compliance, and reviewing budgeting, records, and program planning. #J-18808-Ljbffr Mercor
$70 - $110 per hour
...and Jack Dorsey . Position: Sales Managers Type: Contract Compensation:... ...hours/week Role Responsibilities Evaluate AI-generated sales strategies , quota... ...customer complaint resolution. Provide expert feedback on sales-performance analysis to...Hourly payContract workSummer workImmediate startRemote work- ...clients globally by providing them with evaluated pricing on over three million fixed... ...expertise along with strong quantitative and programming skills to own end-to-end valuation... ...skills to interact with clients, portfolio managers, traders, research, and sales. ~...Full time
JPMorgan Chase & Co.
New York, NY3 days ago $75k - $80k
...Position Summary: The Vocational Evaluation Supervisor manages and supervises the Vocational Evaluation team, oversees the Individualized Vocational... ...and educational achievement of the clients at the program site. What You'll Do Researches, develops, and implements...Fedcap Rehabilitation Services
New York, NY4 days ago$224.3k
General Information Job Title Expert Manager, Product Management & Innovation Job ID 107751 Work Areas Product Management... ...dateBain & Company's comprehensive benefits and wellness program is designed to help employees achieve personal independence,...Permanent employmentFull timeWork at officeLocal areaHome office3 days per weekBain & Company
New York, NY5 days ago$207k - $300k
...knowledge and false assumptions.Build Legal evaluations by assessing industry benchmarks to... ...recruiting and guiding Subject Matter Expert (SMEs), acting as the domain authority... ...Strong technical capabilities, including programming proficiency, evaluating machine...Google
New York, NY4 days ago$190k - $220k
...Operations, Marketing, and Subject Matter Experts to ensure consistent customer-facing... ...commercial playbooks, and sales enablement programs. Experience partnering with Marketing... ...with CRM platforms and pipeline management tools. Experience influencing executive...Flexible hoursSyneos Health, Inc.
New York, NY4 days ago$100 per hour
...Overview We are hiring a senior legal domain expert to work directly with a leading AI lab's research and program management teams, improving how frontier AI models... ...depth: Design challenging legal tasks and evaluation sets, and help build legal-specific skills and...Remote jobFull timeContract workPart timeFreelanceInternshipLive inRelocationRelocation package$260k
...Information Job Title Expert Associate Partner, Commercial... ...ID 111411 Work Areas Management Consulting Employment Type... ...development, building new tools, evaluating partnerships, etc.). The... ...comprehensive benefits and wellness program is designed to help employees...Permanent employmentFull timeBain & Company
New York, NY1 day ago- ...our clients globally by providing them evaluated pricing on over two million fixed income... ...to interact with clients, portfolio managers, traders, research, and sales Strong client... ...vanilla strategies Experience in programming languages such as Python, C++ and high...
- ...are hiring a senior pharmaceutical R&D domain expert to work directly with a leading AI lab's research and program management teams, improving how frontier AI models... ...Design challenging pharmaceutical tasks and evaluation sets, and help build domain-specific skills...Full timeContract workPart timeFreelanceLive inRelocationRelocation package
$137.5k - $186k
Overview The Expert Network is one of Intuit's largest people organizations, sitting within... ...every business line and season. As our Program Design & Operations lead, you'll own the... ...owning the tax content and knowledge management infrastructure that keeps our workforce...Seasonal workWork at office$120 per hour
...Larry Summers , and Jack Dorsey . Position: CUDA Engineering Expert Type: Contract Compensation: $80-$120/hour Location: Remote Role... .... Write, modify, and reason about C++17 , Python , and GPU programming code. Apply CUDA , HIP , and shader programming expertise to improve...Remote jobContract workSummer work- Design, run, and improve training programs from onboarding to workshops. Create content like e-learning modules, curricula, toolkits, and run feedback cycles. About you: 2+ years in L&D, training, or instructional design; LMS experience required. Fluent in English and...Remote jobHome officeFlexible hours
$150 per hour
...and Jack Dorsey . Position: Utilisation Management / Case Management leader (RN/Physician-advisor... ...planning, and care coordination. Evaluate AI-generated medical necessity determinations... .... Manage the physician advisor program to support complex UM cases, peer-to-peer...Remote jobContract workSummer workNight shift$120 - $175 per hour
...Zimbabwe We are building a high-quality evaluation dataset for CNC manufacturing and are seeking... ...grading rubrics that assess whether CAM programs meet the standards required for safe and... ...Details Role: CAM Programming Expert (Fusion 360) Work Arrangement: Fully Remote...Hourly payContract workRemote workFlexible hoursWeekday work$90 per hour
...Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid . Write structured rationales for every...Contract workSummer workLocal areaRemote workMercor
New York, NY24 days ago$100 - $120 per unit
...Summers , and Jack Dorsey . Position Baseball Fan - Live MLB Game AI Evaluator (US) Type Contract Compensation $100-$120 per task Location... ..., rules, challenges, schedules, broadcasts, highlights, and expert-style analysis. Run the same question on two AI products side by...Contract workWork experience placementSummer workRemote work- Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards. Start date: immediate. Duration: up to...Hourly payImmediate start
- Obsidian is seeking a Spanish (Mexico) Audio Generalist Evaluator Expert for a high-impact audio AI research project. The role focuses on transcription, annotation, and evaluation tasks to help train advanced language models. Candidates need to be fluent in Spanish (Mexico...Temporary work10 hours per week
- Mercor is seeking experienced musicians to evaluate generative music AI models, collaborating with a leading AI lab. You will assess AI-generated music and lyrics in Telugu and English, applying detailed quality standards across genres. Responsibilities include comparing...Part timeImmediate start
- We are seeking skilled and experienced Audio Speech Evaluators Experts to assess speech quality and conversational performance through natural, unscripted interactions with an AI bot, in accordance with established evaluation guidelines. The ideal candidates will demonstrate...
- ...Archivist (Kansas City) - State Historical Society of Missouri Audio Digitization and Metadata Specialist Manager of Security and Visitor Experience Collections Emergency Program Specialist. Visual Merchandising and Retail Supervisor Security Officer II-Full time; Thurs-Mon; 9...Remote jobFull timeWork at office
$107.5k - $188.4k
Lead Technical Product Manager - UpToDate Growth At Wolters Kluwer, we combine deep clinical... ...growth for our suite of UpToDate Expert AI products. This role spans the full clinician... ...wide variety of competitive benefits and programs to help meet your needs and balance your...Full timeWork at officeRemote workWolters Kluwer
New York, NY6 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Program Management Expert - Evaluator. Be the first to apply!
Related searches
- subject matter expert New York, NY
- technology expert New York, NY
- fulfillment expert New York, NY
- guest service support expert New York, NY
- sql expert New York, NY
- program evaluator New York, NY
- quality evaluator New York, NY
- evaluator New York, NY
- social media evaluator New York, NY
- education evaluator New York, NY