AI Model Evaluation Specialist — Remote Contract
mercor
New York, NY
- Remote job
Mercor is seeking a seasoned Business Domain Expert to pilot AI model evaluation across admin, marketing, HR and accounting workflows. This remote contractor role focuses on judging outputs with evidence-based rationales and delivering structured feedback within tight turnaround times. You will review model-generated results, document reasoning, and provide design feedback to improve study quality. Ideal candidates have 5+ years in the listed domains and can work independently in a fast-paced AI #J-18808-Ljbffr mercor
Vacancy posted 12 hours ago
Similar jobs that could be interesting for youBased on the AI Model Evaluation Specialist — Remote Contract in New York, NY vacancy
- ...elite creative and technical talent with leading AI research labs. The company is headquartered in San... .... They are hiring a AI Safety Practitioner for a contract role with remote work options. The role focuses on evaluating AI-generated responses for safety, accuracy, and...Contract workRemote jobSummer work
$100 per hour
...your finance expertise to help improve AI models across complex financial problem-... ...required. Key Responsibilities Evaluate language models in finance domains where... ...MBA in Finance. Work Terms Remote independent contract engagement. Flexible commitment of...Contract workRemote workHourly pay10 hours per weekFlexible hoursSaidGig
United Statesmore than 2 months ago$100 per hour
...your finance expertise to improve AI-driven financial applications by... ...providing rigorous, real-world analysis, evaluation, and feedback. This remote, part-time contract role focuses on helping AI... ...financial data, reports, and model outputs using detailed rubrics and...Contract workRemote workHourly payPart timeFor contractorsSaidGig
United Statesmore than 2 months ago$110 per hour
...physician talent network supporting AI labs and companies with medical expertise... ...is an open application for future remote contract opportunities aligned with your... ...bringing real-world clinical expertise to model development and evaluation. Key Responsibilities Train...Contract workRemote workHourly paySaidGig
United Statesmore than 2 months ago$40 - $90 per hour
...medical knowledge and clinical reasoning to help evaluate and improve advanced AI systems. This remote contract role focuses on creating challenging, evidence-based... ...clinical accuracy, and assessing how well AI models handle nuanced medical reasoning. Prior AI experience...Contract workRemote workHourly payFor contractorsSaidGig
United Statesa month ago$50 - $100 per hour
...software engineering and problem-solving expertise to code generation and model evaluation work that helps improve how next-generation AI systems learn, reason, and perform. This remote contract role centers on real-world coding challenges, codebase improvement, technical...Contract workRemote workHourly payFor contractorsSaidGig
United Statesa month ago$85 - $105 per hour
...Help improve how advanced AI systems handle real-world contract work by applying hands-on legal experience... ...part-time contractor role focuses on evaluating and refining AI performance on technology... ...equity firms. Work Terms Remote contract engagement. Part-time...Contract workRemote workHourly payPart timeFor contractorsSaidGig
United States15 days ago$45 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...: Behavioral Health Expert, AI Safety and Model Evaluation Type: Contract Compensation: $45–$70/hour Location: Remote Commitment: 20–40 hours/week Role...Contract workRemote workSummer workWeekday workMercor
New York, NY12 days ago$60 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Machine Learning Engineer — Model Evaluation & Experimentation Type: Contract Compensation: $60–$90/hour Location: Remote Commitment: 35 hours/week Role...Contract workRemote workSummer workMercor
New York, NY28 days ago- ...Mathematics and Statistics experts to support the training and evaluation of state-of-the-art AI systems. We need subject-matter experts who can apply... ...meaningful errors within their field. Flexible, remote contract work starting ASAP. You will work on challenging problems...Contract workRemote jobImmediate startFlexible hours
$41.6k
...are sourcing independent Search Engine Evaluation Specialists to provide their expertise for an AI benchmark evaluation project. As AI models increasingly interpret search intent, analyze... ...Engagement Type: Freelance / Independent Contractor Workplace Type: Remote...Contract workRemote workHourly payFor contractorsFreelance$85 per hour
...technical talent with leading AI research labs.... ...Experience) Type: Contract Compensation: $85/hour Location: Remote Role Responsibilities... ...agents to complete and evaluate complex infrastructure... ...engineering tasks. Review model-generated implementations...Contract workRemote workSummer workMercor
San Francisco, CA9 days ago$30 - $100 per hour
...workflows that help improve next-generation AI systems. This remote contract role centers on producing accurate... ...documentation, and detailed evaluation materials. Key Responsibilities... ...labeling, RLHF, AI response evaluation, or model evaluation, is preferred....Contract workRemote workHourly paySaidGig
United States10 days ago$28 - $92 per hour
...and restaurant operations expertise to an AI training initiative focused on improving... ...environments. Annotate and evaluate transaction data, menus, and order flows... ...technology solutions is a plus. Work Terms Remote contract engagement. Work centers on a...Contract workRemote workHourly payCasual workWork at officeSaidGig
United States10 days ago$90 - $170 per hour
...markets knowledge to realistic finance workflows that help produce high-quality data for the development and evaluation of advanced AI systems. This remote contract role centers on completing, explaining, and documenting professional Bloomberg-based research and analysis...Contract workRemote workHourly paySaidGig
United States17 days ago$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered... ...philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities... ...written feedback to improve AI model outputs . Apply deep...Contract workRemote workSummer workWork at officeMercor
Atlanta, GA9 days ago$90 per hour
...technical talent with leading AI research labs.... ...Frontend Engineer Type: Contract Compensation: $90/hour Location: Remote Role... ...fidelity in detail: box model and spacing, typography... ...preference-labeling, model-evaluation, or structured code-review...Contract workRemote workSummer workLocal areaMercor
San Francisco, CAa month ago$75 - $115 per hour
...Help advance frontier AI models by bringing rigorous pharmaceutical... ...judgment to the evaluation, design, and... ...researchers and adjacent-domain specialists to build... ...biotechnology company, contract research organization,... ...required. This is not a remote role. Candidates must...Contract workHourly payFull timeLive inRelocationRelocation packageSaidGig
California10 days ago$45 - $70 per hour
Gridnaut Recruiting is hiring a remote Behavioral Health Expert, AI Safety and Model Evaluation contractor (pay $45-$70/hr). Contribute to frontier AI research... ...workers, psychologists, case managers, peer support specialists) helping evaluate how AI models handle sensitive...Contract workRemote workPart timeFor contractors$31 - $60 per hour
...and privacy safeguards of data used to train next-generation AI systems. Key Responsibilities Perform detailed post-transformation... ..., legal, or data-privacy roles is an advantage. Work Terms ~ Remote contract engagement. Compensation ~$31 to $60 per hour....Contract workRemote workHourly paySaidGig
United Statesmore than 2 months ago- A growing AI company is seeking Experts in Finance to enhance AI models for performance improvement. This role offers complete flexibility in hours (1... ...financial concepts. This is an entry-level contract position with remote capabilities and opportunities for on-job training...Contract workRemote jobHourly pay
- ...Role Overview Apply research-grade expertise to help evaluate and improve AI reasoning across technical and humanities disciplines, including STEM, English, literature, and journalism. This remote contract role focuses on producing rigorous training data, evaluations...Contract workRemote workHourly payFor contractors
SaidGig
United States10 days ago $45 - $70 per hour
...Category: AI Safety & Red Teaming · Pay: $45–$70 / hr · Location: Remote — US-eligible · Contractor Behavioral Health Expert, AI Safety and Model Evaluation is a remote red-team track for stress-testing... .... Remote · Independent specialist contractor. Employment type...Contract workRemote workFor contractors10 hours per weekAuraOne
San Jose, CA5 days ago$40 - $90 per hour
...expertise to help train and evaluate next-generation AI systems through rigorous,... ...materials that shape how AI models interpret, reason, and respond... ...when completing remote work independently. Familiarity... ...required. Work Terms Remote contract engagement. Compensation...Contract workRemote workHourly paySaidGig
United States10 days ago$50 per hour
...performance of large language models on real-world finance tasks by evaluating model outputs, designing... ...working directly with AI researchers to shape... ...research and finance. Fully remote, flexible work... ...Terms Engagement type, contract. Location, fully remote...Contract workRemote workHourly pay10 hours per weekFlexible hoursSaidGig
United States11 days ago$60 - $80 per hour
...mathematical expertise to support AI research and product... ...this expert network train and evaluate mathematical models, design realistic problem... ...be considered for future contract assignments rather than a single... ...with project teams remotely, communicating findings and...Contract workRemote workHourly payImmediate startSaidGig
United States10 days ago$110 per hour
...clinical expertise to help train, evaluate, and shape medical AI systems by joining a... ...to be considered for future contract opportunities with AI labs... ...Responsibilities Train and evaluate AI models in medical and clinical... ...to work independently in a remote environment. Work Terms...Contract workRemote workHourly paySaidGig
United States11 days ago$60 - $90 per hour
...About the role Machine Learning Engineer — Model Evaluation & Experimentation is a remote review track for evaluating AI outputs across machine learning engineer model evaluation experimentation specialist operations workflows. Reviewers grade workflow correctness,...Contract workRemote workFor contractorsWork experience placement10 hours per weekAuraOne
San Jose, CA14 days ago$40 - $90 per hour
...train next-generation AI systems through rigorous, real-world medical evaluation work. You will create and... ...and manage independent remote work reliably.... ...machine-learning systems and model evaluation is helpful but... ...Work Terms Remote contract engagement. Compensation...Contract workRemote workHourly paySaidGig
United States10 days ago$80 per hour
...technical talent with leading AI research labs.... ...Experience) Type: Contract Compensation: $80/hour Location: Remote Role Responsibilities... ...agents to complete and evaluate complex data engineering tasks. Review model-generated implementations...Contract workRemote workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Model Evaluation Specialist — Remote Contract. Be the first to apply!
Related searches
- ai scientist New York, NY
- ai data scientist New York, NY
- c++ remote New York, NY
- senior devops engineer remote New York, NY
- remote .net full stack web developer New York, NY
- nursing recruiter (remote) New York, NY
- agile coach / scrum master (remote) New York, NY
- clinical data coordinator remote New York, NY
- pmp - project manager - remote New York, NY
- part time project manager remote New York, NY