Program Management Expert - Evaluator - AI Trainer
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Program management / implementation planning Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI outputs.
- Collaborate asynchronously to ensure high-quality evaluations.
- Work independently to meet deadlines and enhance model performance.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Program management / implementation planning .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher ) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercor$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location...SuggestedContract workSummer workWork at officeRemote work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered... .... Position: Utilisation Management / Case Management leader (RN/... ...planning, and care coordination. Evaluate AI-generated medical... ...Manage the physician advisor program to support complex UM cases,...SuggestedContract workSummer workRemote workNight shift$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ..., and Jack Dorsey . Position: Management Consulting Expert Type: Contract Compensation:... ...experience with AI training , evaluation, or human-data projects. Application...SuggestedContract workSummer workRemote work$80 - $160 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Product / Artifacts Experts Type: Contract Compensation: $... ...structured feedback to enhance document evaluation projects. Utilize strong analytical skills...SuggestedContract workSummer workRemote work$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation... .../week Role Responsibilities Evaluate and compare AI-generated responses to challenging...SuggestedFull timeContract workSummer workImmediate startRemote workFlexible hours$70 - $100 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Procurement Expert Type: Contract Compensation: $... ...procurement, spend operations, or vendor management. ~ Hands-on experience running real vendor...Contract workSummer workRemote work$70 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Knowledge Management Expert Type: Contract Compensation... ...Role Responsibilities Evaluate answers from enterprise search and workplace...Full timeContract workSummer workRemote work$293.5k
General Information Job Title Expert Senior Manager, AI Engineering Job ID 104335 Work... ...research, model experimentation, and evaluation design to production system... ...leading complex, multi-stack generative AI programs from conception through productionStrong...Permanent employmentFull timeApprenticeshipWork at officeLocal areaWork from homeHome office3 days per week$70 - $110 per hour
...technical talent with leading AI research labs.... ...and Information Systems Managers Type: Contract... ...Role Responsibilities Evaluate AI-generated project plans... ...support. Provide expert feedback on team assignments... ...analysis, or computer programming teams. ~ Ability to...Hourly payContract workSummer workImmediate startRemote work$60 - $100 per hour
...technical talent with leading AI research labs. Headquartered in... .... Position: Marketing Expert — Creator & Influencer (AI Agent... ...briefs based on real-world creator programs, focusing on planted issues... ...Review AI agent attempts and evaluate them against established standards...Contract workSummer workRemote work$92 per hour
...and technical talent with leading AI research labs. Headquartered in... ...early-out collections, bad debt management, and patient payment plan administration. Evaluate AI-generated patient financial... ...-out and bad debt collection programs, including vendor oversight. ~...Contract workSummer workRemote work$55 per hour
...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is... ...Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or...Permanent employmentTemporary workPart timeFreelance10 hours per week$55 per hour
...intelligence to ethically shape the future of AI. What We Do The Mindrift platform,... ...and powered by Toloka, connects domain experts with cutting‑edge AI projects from... ...learn how modern AI systems are tested and evaluated? This is a flexible, project‑based opportunity...Permanent employmentPart timeFreelanceRemote workFlexible hours$55 per hour
...Freelance Chemistry Expert with Python - AI Trainer 1 week ago Be among the first 25 applicants This opportunity is only for candidates currently... ...AI. Define comprehensive scoring criteria to evaluate the accuracy of the AI's answers. Correct the model's...Part timeFreelanceRemote work$60 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...enhance learning. Qualifications Must-Have Experience managing engagement teams or owning a book of work in professional services...Contract workSummer workRemote work$260k
...Information Job Title Expert Associate Partner,... ...11411 Work Areas Management Consulting Employment... ..., building new tools, evaluating partnerships, etc.). The... ...and applications of AI/ML/GenAI to pricing use... ...benefits and wellness program is designed to help employees...Permanent employmentFull time$80 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: Medical Billing Manager Type: Contract Compensation... ...billing environments. Evaluate AI-generated billing outputs... ...interpretation and billing compliance program management. Application...Contract workSummer workRemote work- ...role you will:Work with domain experts to understand engineering and... ...and have developed strong programming and data-analysis skills, we... ...Context Labs builds industrial AI data infrastructure for global... ...any output, from carbon management and compliance to commercial...
$107.5k - $188.4k
Lead Technical Product Manager - UpToDate Growth At Wolters Kluwer,... ...clinical expertise with responsible AI to build products that improve... ...for our suite of UpToDate Expert AI products. This role spans... ...variety of competitive benefits and programs to help meet your needs and...Full timeWork at officeRemote work$100 - $130 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: Domain Expert – Radiology (Visage 7 Research) Type:... ...Location: Remote Role Responsibilities Evaluate patient/study records to ensure they...Contract workSummer workRemote work$90 per hour
...technical talent with leading AI research labs. Headquartered in... .... Position: Study Domain Expert — Judge Calibration — Sales... ...deadlines and ensure high-quality evaluations. Qualifications Must-... ...relevant field. ~ Ideally held a manager, director, or principal-level...Hourly payContract workFor contractorsSummer workRemote work- ...contributors for flexible, project-based roles that require a strong background in finance. You will design complex tasks that challenge AI agents and enhance their learning. Ideal candidates have a Bachelor's or Master's degree, extensive experience in finance, and...Remote workFlexible hours
- A commercial property management firm located in Houston is seeking a Commercial Property Accountant. The role requires a strong background... ...benefits, including medical and an annual profit-sharing program. This is a full-time position at the mid-senior level. #J-1880...Full time
$175k - $250k
...that support the accurate pricing and risk management of commodity derivatives across the front... ..., and disability insurance; and wellness programs. Citi also offers paid time off packages,... .... Our automated processing and AI do not involve relying on automatic or autonomous...Full timeWork at officeRemote work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered... .... Position: Utilisation Management / Case Management leader (RN/... ...planning, and care coordination. Evaluate AI-generated medical... ...Manage the physician advisor program to support complex UM cases,...Contract workSummer workRemote workNight shift$124k - $280k
...developing and implementing advanced AI and ML solutions to drive... ...and health plans. As a Senior Manager, you will drive use case... ...operations, and population health programs — to identify AI and GenAI opportunities... ...closely with team members. We evaluate these factors thoughtfully to...Full timeH1b- ...stage of growth. The Engineering, Data & AI pillar provides the technical capabilities... ...Enablement, Data Engineering, Data Management, AI Engineering, DataOps/MLOps, and the interfaces... ...Platforms, Cybersecurity, and Technical Program Management & Delivery.This role is...For contractors
$91k - $321.5k
...- Information Technology (IT)Management LevelSenior ManagerJob Description... ...OpportunityAs a CTIO - AI Engineer- Senior Manager, you... ...analytics frameworks- Utilizing programming languages and machine... ...closely with team members. We evaluate these factors thoughtfully to...Full timeH1b$203.5k
...Job Title Lead, AI Engineering Job ID... ...Analytics, Data & Research, Management Consulting, Technology... ...consultants, other experts in product, design, architecture... ...experimentation, evaluation design, and production... ...benefits and wellness program is designed to help...Permanent employmentFull timeApprenticeshipWork at officeLocal areaWork from homeHome office3 days per week$50 - $55 per hour
...technical talent with leading AI research labs. Headquartered in... ...Role Responsibilities Evaluate the accuracy and depth of AI-... ...Collaborate with subject matter experts to ensure consistency, relevance... ..., and quoting. ~4+ years managing a B2B or distribution sales team...Contract workSummer workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Program Management Expert - Evaluator - AI Trainer. Be the first to apply!




