Dermatology MD - AI Evaluation Specialist
Mercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Dermatologist (MD) — Clinical Image Interpretation & AI Evaluation
Type: Contract
Compensation: $270/hour
Location: Remote
Role Responsibilities
- Evaluate and annotate dermatological images using precise medical terminology across diverse skin tones.
- Develop structured image annotations describing lesions by morphology, color, configuration, distribution, and body site.
- Review AI-generated dermatological assessments against clinical standards to flag inaccuracies.
- Author grading criteria and guidelines to ensure consistent judgment at scale.
- Construct difficult cases to test model reasoning, including varied presentations across skin tones.
- Work independently and asynchronously to meet throughput targets in different workstreams.
Qualifications
Must-Have
- MD or DO with completed dermatology residency .
- Board certification or board-eligible with residency complete.
- Active, unrestricted medical license in your country of practice.
- 3+ years post-residency clinical dermatology experience.
- Strong ability to identify and describe dermatological conditions in precise medical terminology.
- Written and spoken English fluency.
- Minimum 15 hours per week commitment.
Preferred
- Fellowship or focused practice in dermatopathology, pediatric dermatology, surgical dermatology, or complex medical dermatology.
- U.S. licensure and board certification.
- Experience in medical image annotation, AI evaluation, or dataset curation.
- Teaching, rubric design, or resident assessment experience.
- Published research or sustained technical writing.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Dermatology MD - AI Evaluation Specialist in New York, NY vacancy
- ...for non-clinical work developing and evaluating clinical AI systems. You will apply your diagnostic... ...helps define what a clinically sound dermatological assessment looks like. This is a non-... ...matched to. Required qualifications MD or DO with completed dermatology residency...SuggestedShift work
- ...Psychiatrists to contribute clinical expertise to an innovative AI training project. You will develop and evaluate complex psychiatric case studies, assess AI-generated... ...harmful AI-generated outputs. Medical degree (MD, MBBS, or equivalent). Completed psychiatry residency...Suggested
$97k - $165k
...available in our New York City office or with our AI Engineering squad in Harbor Point, Baltimore, MD. In either location, you will join a collaborative... ...prompt engineering, tool use, retrieval-based systems, evaluation frameworks, observability, and guardrails. Champion...SuggestedFull timeWork at officeLocal areaRemote work3 days per weekT. Rowe Price
New York, NY3 days ago$121k - $206k
...available in our New York City office or with our AI Engineering squad in Harbor Point, Baltimore, MD. In either location, you will join a collaborative... ..., including architecture, implementation, testing, evaluation, deployment, observability, and production support....SuggestedFull timeWork at officeLocal areaRemote work3 days per weekT. Rowe Price
New York, NY2 days ago$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: General Clinician (MD/DO) - HLS Expert Pool Type: Contract... ...consistent model response grading. Evaluate clinical dialogues for accuracy safety completeness...SuggestedFull timeContract workSummer workRemote workMercor
New York, NY5 days ago$145k - $247k
...available in our New York City office or with our AI Engineering squad in Harbor Point, Baltimore, MD. In either location, you will join a collaborative... ...engineering standards for production AI, including evaluation, testing, observability, guardrails, failure handling...Full timeWork at officeLocal areaImmediate startRemote workWork from home3 days per weekT. Rowe Price
New York, NY5 days ago$130 per hour
Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation isproject-based. What... ...-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes...Hourly payPermanent employmentPart time10 hours per week- ...A leading AI organization in Australia is seeking individuals with strong writing and analytical skills to evaluate and improve AI outputs. The ideal candidate must possess the ability to assess emotional nuances and detail while adhering to structured guidelines. Responsibilities...Immediate start
Crossing Hurdles
New York, NY4 days ago - Partner Company is seeking a skilled evaluator to test new AI model versions across diverse topics and evaluate responses against quality standards. You will write, test, and refine system prompts to influence model behavior and performance, identify and document failures...Remote jobFull timeContract work
$10 - $18 per hour
Jobgether SRL seeks a language professional for a flexible, remote engagement to evaluate and improve AI Tamil interactions. You will translate prompts from English into Tamil and assess AI responses for accuracy, tone, and cultural relevance. Ideal candidates bring linguistics...Remote jobHourly payTemporary workFlexible hours- AI Trainer Jobs seeks a Generalist (Macbook User) to remotely evaluate prompts and responses against AuraOne's rubric. You will compare paired outputs, label edge cases, and draft structured feedback for retraining. Role involves reviewing frontier model outputs, judging...Remote job
- Dorado is seeking language professionals for a six‑month, independent contractor engagement to contribute to an AI evaluation project. Review AI‑generated content, annotate language data, and provide feedback to improve accuracy and reliability. The role requires reliability...For contractors
$18 per hour
We are looking for Speech AI Evaluation Specialist to support the improvement of AI-generated content in Chinese Simplified (USA) . Job Type: Freelance Location: USA (work from home) Work Schedule: Part-time - 10+ hours per week. Flexible - work whenever you want. Start...Hourly payExtra incomePart timeFreelanceImmediate startRemote workWork from home10 hours per weekFlexible hours$30 per hour
BANGLA AI EVALUATION SPECIALIST Up to $30/hr Depending on the project Bachelor's Remote Part-time Flexible hours Opportunity Overview Handshake is looking for Bangla speakers as it’s spoken in Singapore to help make AI responses more personalized. This is not a traditional...Part timeLocal areaRemote workFlexible hours- Anyone AI is seeking remote independent contractors to help create and evaluate data for frontier AI models. You will interact with AI models and compare responses to ensure quality and reliability. Responsibilities include assessing accuracy, helpfulness, and instruction...Remote jobFor contractors
- AuraOne is seeking a Humanities Evaluation Specialist to remotely review AI outputs within operations workflows. You will grade workflow correctness, policy adherence, and stakeholder fit, and document actionable next steps to guide the training team. The role is remote...Remote jobHourly payFor contractorsFlexible hours
- micro1 is a data lab that helps AI labs and enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM capabilities, as well as contextual evaluations to monitor and improve AI agents in enterprise...Remote jobFor contractors
- ...an Electrical & Electronics Expert for a remote, part-time contract role at $50/hour, supporting 15-20 hours per week. You will evaluate AI models on visual document understanding within the Electrical & Electronics domain and author tasks with clear ground-truth outputs...Remote jobContract workPart time
- AI Evaluation Specialist Role Type: Contractor Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project. You'll...Remote jobFor contractors
- ESR Healthcare in the United States is seeking an English-speaking Generalist contractor to support AI model evaluation. You will create prompts, run tests, and document results by recording your screen and voice as you compare multiple models. The role requires clear American...Remote jobFor contractors
- AuraOne, Inc. is seeking an independent contractor to remotely review japanese generalist evaluation prompts and responses, applying a versioned rubric to assign severity tags. You will compare paired outputs, provide rationales, and flag issues like hallucinations or...Remote jobFor contractors
$30 per hour
...Prolific is seeking Fluent Korean Speakers to join our Expert Network. You will help train and evaluate AI models by completing paid tasks and passing a quick skills test to join as a participant. You can work from home and earn competitive pay. Researchers paying for...Self employmentRemote workWork from homeProlific
New York, NY2 days ago- ...Key Responsibilities • Design and implement evaluation metrics for AI models • Conduct thorough testing of model performance across different scenarios • Analyze model outputs for bias, fairness, and accuracy • Collaborate with ML engineers to implement improvements...Temporary work
Rise Data Labs
New York, NY7 days ago - AuraOne, Inc. is seeking a remote evaluator to review Vietnamese generalist evaluation prompts and responses against the company rubric. This contractor role focuses on labeling edge cases, providing structured feedback, and contributing to model retraining efforts. The...For contractorsRemote work
- AI Trainer Jobs is seeking contributors for remote language evaluation work. You will assess Slovak translations and localization, rate model outputs, and provide corrected answers to improve AI training. The role offers flexible hours, remote collaboration, and weekly...Remote jobFor contractorsFlexible hours
$20 - $80 per hour
...Role Overview Help improve next-generation AI systems by supplying precise, real-world evaluation, annotation, and feedback. This remote contractor role focuses on how AI models learn, reason, and perform across diverse subject areas. Key Responsibilities Evaluate...Hourly payContract workFor contractorsRemote workSaidGig
New York, NY6 hours ago$60 - $70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...$60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance...Contract workSummer workRemote workMercor
New York, NY28 days ago- About the Opportunity A leading AI research organization is seeking advanced LLM power users with strong experience using MCP and (... ...connectors for real-world personal life tasks. This project focuses on evaluating how well AI systems handle personalized, multi-step life tasks...Trial period
- Prolific is seeking Computer Science Specialists to join its Expert Network to help train and evaluate AI models. You’ll take a brief skills test and, if successful, become a paid participant working from home to support high‑quality data collection. You will rank AI outputs...Remote jobWork from home
$40 per hour
A leading company in AI training solutions is seeking a Content Developer specialized in Physics. The role involves enhancing AI models by providing and evaluating complex physics problems. Ideal candidates hold advanced degrees in physics or related fields, ensuring high...Remote jobHourly pay
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Dermatology MD - AI Evaluation Specialist. Be the first to apply!
Related searches
- ai data scientist New York, NY
- ai scientist New York, NY
- dermatology New York, NY
- research fellow dermatology New York, NY
- dermatology rn New York, NY
- physician assistant dermatology New York, NY
- dermatology office New York, NY
- dermatology on call New York, NY
- dermatology manager New York, NY
- lpn dermatology New York, NY