Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Dermatology MD - AI Evaluation Specialist

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Dermatologist (MD) — Clinical Image Interpretation & AI Evaluation
Type: Contract
Compensation: $270/hour
Location: Remote

Role Responsibilities

  • Evaluate and annotate dermatological images using precise medical terminology across diverse skin tones.
  • Develop structured image annotations describing lesions by morphology, color, configuration, distribution, and body site.
  • Review AI-generated dermatological assessments against clinical standards to flag inaccuracies.
  • Author grading criteria and guidelines to ensure consistent judgment at scale.
  • Construct difficult cases to test model reasoning, including varied presentations across skin tones.
  • Work independently and asynchronously to meet throughput targets in different workstreams.

Qualifications

Must-Have

  • MD or DO with completed dermatology residency .
  • Board certification or board-eligible with residency complete.
  • Active, unrestricted medical license in your country of practice.
  • 3+ years post-residency clinical dermatology experience.
  • Strong ability to identify and describe dermatological conditions in precise medical terminology.
  • Written and spoken English fluency.
  • Minimum 15 hours per week commitment.

Preferred

  • Fellowship or focused practice in dermatopathology, pediatric dermatology, surgical dermatology, or complex medical dermatology.
  • U.S. licensure and board certification.
  • Experience in medical image annotation, AI evaluation, or dataset curation.
  • Teaching, rubric design, or resident assessment experience.
  • Published research or sustained technical writing.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 10 days ago
Similar jobs that could be interesting for youBased on the Dermatology MD - AI Evaluation Specialist in New York, NY vacancy
  •  ...for non-clinical work developing and evaluating clinical AI systems. You will apply your diagnostic...  ...helps define what a clinically sound dermatological assessment looks like. This is a non-...  ...matched to. Required qualifications MD or DO with completed dermatology residency... 
    Suggested
    Shift work

    Obsidian

    New York, NY
    6 days ago
  •  ...certified Dermatologists for non-clinical work developing and evaluating clinical AI systems, applying diagnostic expertise to image...  ...evaluation to define what constitutes a clinically sound dermatological assessment. This is a shared expert pool with onboarding that... 
    Suggested
    Flexible hours
    Shift work

    Mercor

    New York, NY
    6 days ago
  • $121k - $206k

     ...available in our New York City office or with our AI Engineering squad in Harbor Point, Baltimore, MD. In either location, you will join a collaborative...  ..., including architecture, implementation, testing, evaluation, deployment, observability, and production support.... 
    Suggested
    Full time
    Work at office
    Local area
    Remote work
    3 days per week

    T. Rowe Price

    New York, NY
    1 day ago
  •  ...A leading AI organization in Australia is seeking individuals with strong writing and analytical skills to evaluate and improve AI outputs. The ideal candidate must possess the ability to assess emotional nuances and detail while adhering to structured guidelines. Responsibilities... 
    Suggested
    Immediate start

    Crossing Hurdles

    New York, NY
    3 days ago
  • $97k - $165k

    AI Software Engineer- T. Rowe Price Labs (NY or MD) Apply ( locations New York, NY Baltimore, MD time type Full time posted on Posted 3 Days Ago job...  ...engineering, tool use, retrieval-based systems, evaluation frameworks, observability, and guardrails. Champion... 
    Suggested
    Full time
    Work at office
    Local area
    Remote work
    3 days per week

    T. Rowe Price

    New York, NY
    2 days ago
  • Welo Data is hiring Data Labeling Associates in New York City for Project Perseus. The role involves evaluating Arabic language AI outputs and ensuring AI safety, requiring professional proficiency in Arabic and experience in writing and AI safety. You’ll critique models... 

    Welo Data

    New York, NY
    6 days ago
  •  ....zone is seeking a Remote Data Labeling Specialist to work from anywhere within the United...  ...will label and review multi-modal data for AI training, including text, images, audio,...  ...segmentation, content safety labeling, and RLHF-style evaluation tasks. #J-18808-Ljbffr REX
    Remote job

    REX

    New York, NY
    5 days ago
  • $11 - $30.65 per hour

    Meridial is seeking contractors to evaluate advanced agentic audio models by simulating realistic customer service interactions across multiple domains. You will contribute to developing diverse datasets and assess model performance using various metrics. The role requires... 
    Remote job
    Hourly pay
    For contractors

    Meridial

    New York, NY
    5 days ago
  • YO AI Labs seeks a Creative & Design Specialist to evaluate AI-generated outputs and provide high-quality human feedback. You will work on graphic design, UI/UX, motion graphics, and multimedia tasks, applying professional standards and contributes to training AI models... 
    Remote job
    Worldwide
    Flexible hours

    YO AI Labs

    New York, NY
    3 days ago
  • Obsidian is collaborating with AI labs to find experienced health insurance professionals to enhance AI systems related to coverage...  ...assess AI performance on health insurance tasks. The role includes evaluating AI outputs, creating health insurance scenarios, and providing... 

    Obsidian

    New York, NY
    4 days ago
  • About the Opportunity A leading AI research organization is seeking advanced LLM power users with strong experience using MCP and (...  ...connectors for real-world personal life tasks. This project focuses on evaluating how well AI systems handle personalized, multi-step life tasks... 
    Trial period

    Obsidian

    New York, NY
    4 days ago
  •  ...Job TitleAI Evaluation EngineerLocationHybrid / RemoteEmployment TypeFull-timeJob SummaryWe are seeking an AI Evaluation Engineer to design, implement, and maintain evaluation frameworks for AI and machine learning systems, with a focus on Large Language Models (LLMs)... 

    Ova Technologies

    New York, NY
    4 days ago
  • $80 per hour

     ...human intelligence to ethically shape the future of AI. What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our...  ...for someone who can design realistic and structured evaluation scenarios for LLM-based agents. You'll create test... 
    Part time
    Freelance
    Remote work
    Flexible hours

    Mindrift

    New York, NY
    3 days ago
  • YO AI Labs is seeking an experienced Management Consultant to support AI training and evaluation projects. This contractor role emphasizes structured problem-solving, business analysis, and consulting expertise to assess and improve AI model performance. Remote work enables... 
    Remote job
    For contractors

    YO AI Labs

    New York, NY
    4 days ago
  • $30 - $50 per hour

    A tech company is seeking an AI Researcher to support end-to-end research for modern AI systems. This remote role involves designing experiments, defining evaluation protocols, and improving evaluation rigor for large language models. Key responsibilities include developing... 
    Remote job
    Hourly pay

    REX

    New York, NY
    3 days ago
  • $400 per month

    Obsidian is seeking contributors for a Frontier Code Agents project, focused on evaluating AI coding models in fraud and risk engineering. Candidates will use AI coding tools to handle complex tasks and provide technical assessments. The role requires 2+ years of experience... 

    Obsidian

    New York, NY
    2 days ago
  • $20 - $160 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Position: Generalist Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour Location... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    12 days ago
  • $50 - $190 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Remote Commitment: 20+ hours/week Role Responsibilities Evaluate AI systems on complex personal workflows, including personal... 
    Hourly pay
    Contract work
    For contractors
    Summer work
    Remote work
    Trial period

    Mercor

    New York, NY
    23 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  .... Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    23 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    12 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Jack Dorsey . Position: Data analysis / quantitative readouts Evaluator Type: Contract Compensation: $80–$120/hour... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    12 days ago
  •  ...has about 60 attorneys, 75 staff and over 50 staff attorneys. About the Team and the Role The Junior AI Specialist will support the firm’s efforts to evaluate, test, and responsibly adopt generative AI tools in support of legal work. Based in our New York office,... 
    Full time
    Contract work
    Work at office
    Work from home
    Worldwide

    Bernstein Litowitz Berger & Grossmann LLP

    New York, NY
    4 days ago
  • $197.3k - $225.1k

    AI Engineer 4 (Gen AI Platform Services: Agentic AI, Agent Guardrails, Agent Evaluation, Agent Memory) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    4 days ago
  • Data & AI Solutions Consultant Databricks SFO -CA -/ Remote Duration - 8-12 months Core Skills Needed 12+ years of full-stack engineering...  ...Generation (RAG), AI agents, prompt engineering, model evaluation, and enterprise AI application patterns. Proficiency with AI-assisted... 
    Remote work

    Georgia IT Inc

    New York, NY
    2 days ago
  •  ...time role, requiring strong analytical skills and independent work. The position involves creating historically relevant prompts, evaluating AI outputs, and contributing to research initiatives. Ideal candidates will hold a PhD in History or a related discipline and... 
    Part time
    Remote work
    Flexible hours

    Crossing Hurdles

    New York, NY
    3 days ago
  •  ...Remote Job Summary We are seeking experienced Senior Software Engineers to support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools.... 
    Remote job
    For contractors

    YO AI Labs

    New York, NY
    4 days ago
  • Meridial is seeking a Danish Voice Acting Specialist to support AI training by providing recorded speech samples and expert feedback. You will...  ...recording setup. You will work collaboratively with a team to evaluate AI output and improve voice design. The position offers a... 
    Remote job
    Hourly pay

    Meridial

    New York, NY
    5 days ago
  • Feedinkoo is seeking a Copywriting & Content Subject Matter Expert to provide expert evaluation of AI-generated content and create high-quality written material. This remote contractor position requires strong copywriting skills and the ability to give precise feedback... 
    Remote job
    Contract work
    For contractors

    Feedinkoo

    New York, NY
    2 days ago
  •  ...individual to support governance, oversight, and responsible adoption of AI technologies across the organization, collaborating with...  ..., compliance, product, and FinOps teams. The role focuses on evaluating AI solutions, maintaining governance standards, monitoring usage... 

    State Street

    New York, NY
    4 days ago
  • $50 per hour

    A leading AI training company is seeking experienced software engineers to help train generative AI models remotely. The role involves crafting questions related to computer science and evaluating AI-generated code. This freelance opportunity offers flexible hours and... 
    Remote job
    Hourly pay
    Freelance
    Flexible hours

    Outlier AI, Inc.

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Dermatology MD - AI Evaluation Specialist. Be the first to apply!