Dermatology MD - AI Evaluation Specialist
Mercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Dermatologist (MD) — Clinical Image Interpretation & AI Evaluation
Type: Contract
Compensation: $270/hour
Location: Remote
Role Responsibilities
- Evaluate and annotate dermatological images using precise medical terminology across diverse skin tones.
- Develop structured image annotations describing lesions by morphology, color, configuration, distribution, and body site.
- Review AI-generated dermatological assessments against clinical standards to flag inaccuracies.
- Author grading criteria and guidelines to ensure consistent judgment at scale.
- Construct difficult cases to test model reasoning, including varied presentations across skin tones.
- Work independently and asynchronously to meet throughput targets in different workstreams.
Qualifications
Must-Have
- MD or DO with completed dermatology residency .
- Board certification or board-eligible with residency complete.
- Active, unrestricted medical license in your country of practice.
- 3+ years post-residency clinical dermatology experience.
- Strong ability to identify and describe dermatological conditions in precise medical terminology.
- Written and spoken English fluency.
- Minimum 15 hours per week commitment.
Preferred
- Fellowship or focused practice in dermatopathology, pediatric dermatology, surgical dermatology, or complex medical dermatology.
- U.S. licensure and board certification.
- Experience in medical image annotation, AI evaluation, or dataset curation.
- Teaching, rubric design, or resident assessment experience.
- Published research or sustained technical writing.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Dermatology MD - AI Evaluation Specialist in New York, NY vacancy
$121k - $206k
...available in our New York City office or with our AI Engineering squad in Harbor Point, Baltimore, MD. In either location, you will join a collaborative... ..., including architecture, implementation, testing, evaluation, deployment, observability, and production support....SuggestedFull timeWork at officeLocal areaRemote work3 days per weekT. Rowe Price
New York, NY4 days ago- ...A leading AI organization in Australia is seeking individuals with strong writing and analytical skills to evaluate and improve AI outputs. The ideal candidate must possess the ability to assess emotional nuances and detail while adhering to structured guidelines. Responsibilities...SuggestedImmediate start
Crossing Hurdles
New York, NY1 day ago $60 - $70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...$60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance...SuggestedContract workSummer workRemote workMercor
New York, NY4 days ago$20 - $160 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Position: Generalist Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour Location...SuggestedContract workSummer workRemote workMercor
New York, NY4 days ago$229.9k - $262.4k
...AI Engineer 5 (SDK's: Gen AI Evaluation and MCP) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real‑time, personalized customer experiences...SuggestedFull timePart timeLocal areaCapital One National Association
New York, NY21 hours ago$197.3k - $225.1k
AI Engineer 4 (AI Foundations: Benchmarking, Evaluation, and Explainability)At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time,...Full timePart timeLocal areaCapital One Group
New York, NY6 hours ago- ...Job TitleAI Evaluation EngineerLocationHybrid / RemoteEmployment TypeFull-timeJob SummaryWe are seeking an AI Evaluation Engineer to design, implement, and maintain evaluation frameworks for AI and machine learning systems, with a focus on Large Language Models (LLMs)...
Ova Technologies
New York, NY2 days ago $197.3k - $245.6k
...per year Requirements: Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related... ...: Proficiency designing distributed systems for model training, evaluation, and online inference at petabyte scale. Preferred: Experience...Full timeCapital One
New York, NY2 days ago$400 per month
Obsidian is seeking contributors for a Frontier Code Agents project, focused on evaluating AI coding models in fraud and risk engineering. Candidates will use AI coding tools to handle complex tasks and provide technical assessments. The role requires 2+ years of experience...$100 - $150 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...work , machine learning pipelines , and technical reports. Evaluate AI-generated or human-created work against established criteria...Contract workSummer workRemote workMercor
New York, NY4 days ago$84 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...jailbreaks, unsafe behaviors, hallucinations, and policy failures. Evaluate model robustness across misinformation, cyber, biosecurity,...Contract workSummer workRemote workMercor
New York, NY4 days ago$30 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...accuracy, relevance, response timing, and spatial language use. Evaluate if the assistant appropriately warned users about health, safety...Contract workSummer workImmediate startRemote workMercor
New York, NY4 days ago$150 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Remote Commitment: 20 hours/week Role Responsibilities Evaluate and enhance AI model capabilities in complex SWE tasks ....Hourly payWeekly payContract workFor contractorsSummer workRemote workMercor
New York, NY4 days ago- ...Capital One is hiring an AI Engineer 5 in New York, NY to partner across engineering, research, and product teams. You will design and deploy AI software components, including model training, inference, agents, and multi‑model workflows, leveraging Open Source and SaaS...
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... .... Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour Location...Contract workSummer workWork at officeRemote work- ...time role, requiring strong analytical skills and independent work. The position involves creating historically relevant prompts, evaluating AI outputs, and contributing to research initiatives. Ideal candidates will hold a PhD in History or a related discipline and...Part timeRemote workFlexible hours
Crossing Hurdles
New York, NY1 day ago $37 per unit
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: AI Safety Specialist Type: Contract Compensation: $... ...Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated...Contract workSummer workRemote workMercor
New York, NY4 days ago$150k
...topics including Digital Transformation, Data & Digital Platforms, AI at Scale, Agile, Cybersecurity and Digitizing the Tech Function.... ...in ERP and similar solutions. Solution Architecture & Design Evaluating an organization’s IT, enterprise applications, data, analytics,...Work at officeLocal areaThe Boston Consulting Group
New York, NY1 day ago$70 - $90 per hour
...clients. We are currently helping hire for one of the leading AI labs (via one of our partners); helping them train their AI... ...improve AI model performance in economics domain. You will be evaluating advanced economics tasks and solutions and provide clear, written...Hourly payFull timePart timeFor contractorsWork experience placementCurrently hiringRemote workFlexible hoursWeekday workWeekday AI
New York, NY1 day ago- Supporting ongoing AI and legal technology initiatives, the part-time AI Integration Specialist will work remotely on a project basis, focusing on chatbot development, integration... ...to identify workflow improvements and evaluate AI-driven legal processes Required...Contract workPart timeRemote workFlexible hours
- ...mature its enterprise artificial intelligence roadmap, the remote AI Specialist will serve as a foundational subject matter expert, managing technology portfolios, leading governance teams, and evaluating high-impact vendor tools in a permanent position. Key...Permanent employmentRemote work
$18 per hour
...intelligence. What We Do Toloka connects individuals with Generative AI projects from leading tech innovators. Our mission is to unlock... ...part in online projects such as rating AI-generated content, evaluating factual accuracy, or comparing responses — when projects are...Part timeFreelanceRemote work- ...Remote Job Summary We are seeking experienced Senior Software Engineers to support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools....Remote jobFor contractors
$8 - $65 per hour
...production expert eager to shape the future of AI? Large‑scale language models are... .... We’re looking for video production specialists who live and breathe cinematography, directing... ...to our prompt engineering and evaluation metrics. A bachelor’s or master’s degree...Hourly payContract workFor contractorsFreelanceImmediate startRemote workInvisible Technologies Inc. Defunct
New York, NY4 days ago$110k
...distinctive style of hospitality. Who you are: The Data and AI Engineer will own the data infrastructure that powers reporting... ...and productionize agentic workflows – including retrieval, evaluation, and guardrails – so AI-generated outputs are reliable enough for...Full timeFlexible hoursUnion Square Hospitality Group
New York, NY10 days ago$40 - $60 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...administration with deterministic rubrics for agent performance evaluation. Develop scenarios in patient access including scheduling...Hourly payWeekly payFull timeContract workFor contractorsSummer workRemote workMercor
New York, NYmore than 2 months ago$73 per hour
...CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment...Permanent employmentTemporary workPart timeFreelance10 hours per weekMind Rift
New York, NY3 days ago$164.6k - $213.1k
...impact and data into action, together.The OpportunityThe Data & AI Product Engineer is a hands-on technologist who sets the technical... ...or AI solutions.Experience designing data and AI architectures, evaluating and building platforms/vendors, and making build vs. buy...Full timeTemporary workWork at officeLocal areaRelocation packageShift work3 days per weekMetropolitan Life Insurance Company
New York, NY4 days ago$73 per hour
...collective intelligence to ethically shape the future of AI. What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our... ...to learn how modern AI systems are tested and evaluated? This is a flexible, project‑based opportunity...Permanent employmentPart timeFreelanceRemote workFlexible hoursMind Rift
New York, NY3 days ago$8 - $65 per hour
...fluent in Thai eager to shape the future of AI? Large-scale language models are... ...generation of AI. We’re looking for LaTeX specialists who live and breathe document typesetting... ...improvements to our prompt engineering and evaluation metrics. A bachelor’s or master’s degree...Hourly payContract workFor contractorsFreelanceRemote workInvisible Technologies Inc. Defunct
New York, NY5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Dermatology MD - AI Evaluation Specialist. Be the first to apply!
Related searches
- ai scientist New York, NY
- ai data scientist New York, NY
- dermatology medical assistant New York, NY
- dermatology New York, NY
- dermatology manager New York, NY
- dermatology associates New York, NY
- schweiger dermatology New York, NY
- lpn dermatology New York, NY
- research fellow dermatology New York, NY
- physician assistant dermatology New York, NY