Program Management Expert - Evaluator
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Program management / implementation planning Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI outputs.
- Collaborate asynchronously to ensure high-quality evaluations.
- Work independently to meet deadlines and enhance model performance.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Program management / implementation planning .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher ) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
- Department of Health and Social Services (DHSS) is seeking a Management Analyst III to serve as the Program Evaluator for the Tobacco Prevention and Control Program. The role involves conducting highly complex studies and analyzing statewide health surveillance data for...SuggestedWork at office
$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedContract workSummer workWork at officeRemote work$70 - $110 per hour
...and Jack Dorsey . Position: Sales Managers Type: Contract Compensation:... ...hours/week Role Responsibilities Evaluate AI-generated sales strategies , quota... ...customer complaint resolution. Provide expert feedback on sales-performance analysis to...SuggestedHourly payContract workSummer workImmediate startRemote work$70 per hour
...seeking an experienced PMO lead to train an AI language model on professional documents, spreadsheets, and slide decks. You will own program charters, RAID logs, and milestone tracking, ensuring accuracy and executive readiness. This fully remote, flexible role calls for...SuggestedRemote jobWeekly payImmediate startFlexible hours- ...Intuit, Inc. is seeking a Program Design & Operations lead for the Expert Network within Expert Services. You will design and govern service delivery standards, own tax content and knowledge management, and ensure readiness across seasonal peaks. You'll work with Service...Suggested
- ...are essential for our clients' investment decisions and risk management strategies.Job Responsibilities:Generate daily valuations of interest... ...and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits...Daily paidWorldwide
$75k - $80k
...Position Summary: The Vocational Evaluation Supervisor manages and supervises the Vocational Evaluation team, oversees the Individualized Vocational... ...and educational achievement of the clients at the program site. What You'll Do Researches, develops, and implements...$224.3k
General Information Job Title Expert Manager, Product Management & Innovation Job ID 107751 Work Areas Product Management... ...dateBain & Company's comprehensive benefits and wellness program is designed to help employees achieve personal independence,...Permanent employmentFull timeWork at officeLocal areaHome office3 days per week$207k - $300k
...knowledge and false assumptions.Build Legal evaluations by assessing industry benchmarks to... ...recruiting and guiding Subject Matter Expert (SMEs), acting as the domain authority... ...Strong technical capabilities, including programming proficiency, evaluating machine...- ...Kong, J.P. Morgan's PricingDirect (PD) evaluators serve clients globally by providing them... ...along with strong quantitative and programming skills to own end-to-end valuation outcomes... ...to interact with clients, portfolio managers, traders, research, and sales. ~ Proven...Full time
$137.5k - $186k
...The Expert Network is one of Intuit's largest people organizations, sitting within Expert... ...business line and season. As our Program Design & Operations lead, you'll own the... ...and owning the tax content and knowledge management infrastructure that keeps our workforce...Seasonal workWork at office- ...clients in the transportation sector to accelerate transformation efforts, make step-changes in major program delivery, and achieve leaps forward in areas such as asset management & maintenance, major projects, railway operations, strategic planning and advisory. Our work is...Work at officeWork from homeHome officeFlexible hours
$100 - $120 per unit
...Jack Dorsey . Position: Baseball Fan Live MLB Game AI Evaluator (US) Type: Contract Compensation: $100$120 per... ...team stats rules challenges schedules broadcasts highlights and expert-style analysis. Run the same question on two AI products side...Full timeContract workWork experience placementSummer workRemote work$80 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $80–$150/hour... ...quickly on work. Work independently and asynchronously to evaluate and improve AI model performance . Qualifications Must-...Contract workSummer workRemote work- ...are hiring a senior pharmaceutical R&D domain expert to work directly with a leading AI lab's research and program management teams, improving how frontier AI models... ...Design challenging pharmaceutical tasks and evaluation sets, and help build domain-specific skills...Full timeContract workPart timeFreelanceLive inRelocationRelocation package
- Design, run, and improve training programs from onboarding to workshops. Create content like e-learning modules, curricula, toolkits, and run feedback cycles. About you: 2+ years in L&D, training, or instructional design; LMS experience required. Fluent in English and...Remote jobHome officeFlexible hours
- USmax Corporation is a remote, mission-driven provider of professional IT services specializing in federal healthcare program integrity. The role focuses on reviewing CMS guidance, developing educational materials, and advising CPI stakeholders on program integrity initiatives...Remote job
- ...of Vanta's GTM-facing GRC Subject Matter Experts, you will be a highly visible, customer-... ...for representing Vanta's Trust Management Platform to prospects and customers, as... ...internal and external stakeholders on GRC programs, including program foundation/scaling strategies...Work experience placementWork at officeImmediate startRemote workFlexible hours
$500 per month
...Larry Summers , and Jack Dorsey . Position: CUDA Engineering Expert Type: Contract Compensation: $500/hour Location: Remote Role Responsibilities... ...background. Write and modify C++17 , Python , and GPU programming code. Apply expertise in CUDA , HIP , and shader programming...Remote jobContract workSummer work- We are seeking skilled and experienced Audio Speech Evaluators Experts to assess speech quality and conversational performance through natural, unscripted interactions with an AI bot, in accordance with established evaluation guidelines. The ideal candidates will demonstrate...
$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote work$80 - $160 per hour
...Summers , and Jack Dorsey . Position: Operations / Program Management Experts Type: Contract Compensation: $80–$160/hour Location... ...structured feedback to improve document standards and evaluation processes. Collaborate with teams to enhance project...Contract workSummer workRemote work$14 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract Compensation: $14/hour Location... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards...Contract workSummer workImmediate startRemote work$39 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - English (US) Type: Contract Compensation: $39/hour... ...months Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output for lyrics, voice generation, and other...Contract workSummer workImmediate startRemote work$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Clinical / biomedical / pharma Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote work$90 per hour
...Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid . Write structured rationales for every...Contract workSummer workLocal areaRemote work$150 per hour
...Larry Summers , and Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation: $150/hour Location:... ...Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses to challenging medical problems...Contract workSummer workImmediate startRemote workFlexible hours$50 per hour
...Summers , and Jack Dorsey . Position: English Language and Literature Expert Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated English text across various use cases...Contract workSummer workRemote work$15 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation: $15/hour... ...months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate it against...Contract workSummer workImmediate startRemote work$70 - $110 per hour
...weeks Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated sales conversations , product recommendations,... ..., order handling, and post-sale support. Provide expert feedback. Work independently and asynchronously to meet deadlines...Hourly payContract workSummer workImmediate startRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Program Management Expert - Evaluator. Be the first to apply!
- subject matter expert New York, NY
- technology expert New York, NY
- fulfillment expert New York, NY
- guest service support expert New York, NY
- sql expert New York, NY
- program evaluator New York, NY
- quality evaluator New York, NY
- evaluator New York, NY
- social media evaluator New York, NY
- education evaluator New York, NY




