Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Internal Medicine AI Evaluation Specialist

$130 - $180 per hour
Part-time

Weekday AI

Role Description

Join a leading AI research initiative focused on advancing healthcare-focused artificial intelligence. We are seeking experienced Internal Medicine physicians to contribute their clinical expertise toward training and evaluating next-generation AI models capable of sophisticated medical reasoning.

In this role, you will:

  • Develop realistic clinical scenarios.
  • Evaluate AI-generated responses against evidence-based standards.
  • Help improve how AI systems reason about diagnosis, treatment planning, and patient management within Internal Medicine.

We welcome Internal Medicine attending physicians, hospitalists, fellows, final-year residents, and other qualified Internal Medicine professionals who are passionate about applying their expertise to the future of healthcare AI.

Qualifications

  • Attending Physicians: Board-certified in Internal Medicine; Current, active, and unrestricted medical license.
  • Resident Physicians: Final-year Internal Medicine resident; Recent residency graduates must be board-eligible.
  • Fellows: Board-certified or board-eligible in Internal Medicine or a related subspecialty; Current, active, and unrestricted medical license.
  • Professionals with expertise in Internal Medicine subspecialties are encouraged to apply, including:
    • Cardiology
    • Hematology & Oncology
    • Endocrinology
    • Nephrology
    • Gastroenterology
    • Pulmonology
    • Other Internal Medicine subspecialties

Requirements

  • Strong knowledge of evidence-based medicine and clinical practice guidelines.
  • Experience in clinical teaching, medical research, or quality improvement initiatives.
  • Excellent written communication and analytical skills.
  • Interest in artificial intelligence, clinical decision support, or healthcare technology.

Benefits

  • Fully remote with 100% asynchronous work.
  • Standard commitment of approximately 20 hours per week, with opportunities for additional hours based on project demand.
  • Flexible working schedule.
  • Weekly payments.
  • Rolling onboarding with ongoing engagement opportunities.
  • Compensation is determined by clinical experience, expertise, and seniority.

Equal Opportunity Statement

All qualified applicants will be considered without regard to legally protected characteristics. Reasonable accommodations are available upon request.

Contract Information

  • Independent contractor engagement.
  • Fully remote work completed on your own schedule.
  • Projects may be extended, modified, or concluded based on business needs and individual performance.
  • Work does not involve access to confidential or proprietary information from any employer, client, or institution.
  • Weekly payments are processed through supported payment platforms based on approved work completed.
  • Please note that visa sponsorship is not available for this opportunity.
Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the Internal Medicine AI Evaluation Specialist in Remote vacancy
  •  ...DataAnnotation is seeking an Internal Medicine Physician to help train AI models. This independent contractor position offers flexibility, allowing you to choose projects and work from home. You will evaluate AI model outputs for healthcare-related tasks, ensuring accuracy... 
    Suggested
    For contractors
    Remote work
    Work from home

    DataAnnotation

    Florida, NY
    5 days ago
  • $50 - $60 per hour

     ...DataAnnotation is seeking an Internal Medicine Physician to assist in training AI models by evaluating their outputs and ensuring the medical accuracy of model performance. This independent contractor position allows for flexible scheduling and remote work. Applicants... 
    Suggested
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    California, MO
    5 days ago
  • $50 - $60 per hour

    DataAnnotation is seeking an Internal Medicine Physician to help train AI models. In this role, you will evaluate AI outputs and ensure medical accuracy while working from home. Ideal candidates will have fluency in English and are required to have a current or in-progress... 
    Suggested
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    DataAnnotation

    Annapolis, MD
    3 days ago
  • DataAnnotation is seeking an Internal Medicine Physician to evaluate and enhance AI models. In this role, you will work from home, on your schedule, tackling diverse healthcare-related problems to ensure the quality and accuracy of AI-generated outputs. Candidates must... 
    Suggested
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    DataAnnotation

    Madison, WI
    2 days ago
  • $20 per hour

    A leading AI model training company is seeking a Pyxis Technician to join their team. This role involves training AI models by evaluating outputs for logic and medical accuracy while providing complex healthcare-related problems. Ideal candidates should have a healthcare... 
    Suggested
    Hourly pay
    Remote work

    DataAnnotation

    Louisiana, MO
    4 days ago
  • $20 per hour

    A healthcare technology firm is seeking a Pyxis Technician to join their team for training AI models and evaluating AI chatbot logic. The role is remote and offers flexible scheduling with project-based payment starting at $20 per hour. Candidates should be fluent in English... 
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    Saint Paul, MN
    4 days ago
  •  ...is seeking a Pyxis Technician to join their team in the United States. This remote position involves training AI models for healthcare applications, evaluating their logic, and solving complex problems to improve quality. Candidates should have a background in healthcare... 
    Hourly pay
    Remote work

    DataAnnotation

    Bismarck, ND
    4 days ago
  • $20 per hour

    A leading AI model training company is seeking a Pyxis Technician to join its team. In this role, you will train AI models by measuring their progress, evaluating outputs for accuracy, and solving healthcare-related problems. Ideal candidates should have a strong background... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Juneau, AK
    4 days ago
  • $20 per hour

    A healthcare technology company based in the United States is seeking a Pyxis Technician to enhance AI models. This role involves evaluating AI outputs for accuracy and providing complex healthcare-related problems for chatbots. Candidates should have expertise in healthcare... 
    Hourly pay
    Remote work

    DataAnnotation

    Nevada, IA
    4 days ago
  • $20 per hour

     ...healthcare technology company based in the United States is seeking a Pyxis Technician to improve AI model quality. In this role, you will utilize your healthcare expertise to evaluate AI chatbots, ensuring their medical accuracy and performance. The position is flexible,... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Indiana, PA
    4 days ago
  • $20 per hour

    A healthcare technology firm is seeking a Pyxis Technician to enhance AI models by evaluating logic and accuracy in responses. The role requires expertise in various healthcare fields, including Revenue Cycle Management and Pharmacy Operations. This independent contractor... 
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    Wisconsin
    4 days ago
  • $20 per hour

    A healthcare technology firm is seeking a Pyxis Technician to train AI chatbots by providing them with healthcare-related problems and evaluating their outputs. Candidates should have fluency in English and a current or in-progress degree in a healthcare-related field.... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Jackson, MS
    4 days ago
  • $40 per hour

     ...We are looking for a Graduate Biology Research Intern to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role you will need to hold an expert... 
    Hourly pay
    Full time
    Contract work
    Part time
    Internship
    Remote work

    DataAnnotation

    Indiana, PA
    4 days ago
  • $20 per hour

    A healthcare technology company is seeking a Pyxis Technician to evaluate AI chatbots and improve model quality through healthcare-related expertise. The role offers flexibility in project selection and a remote work setting. Candidates must be fluent in English and possess... 
    Hourly pay
    Remote work

    DataAnnotation

    Brooklyn, NY
    5 days ago
  • A specialized AI training team is seeking a Pyxis Technician to enhance AI models with healthcare-related expertise. This role involves evaluating chatbots for logic and accuracy and ensuring the quality of responses. Candidates should possess a current or in-progress... 
    Hourly pay
    Remote work

    DataAnnotation

    Wausau, WI
    4 days ago
  • $20 per hour

    A leading AI development company is seeking a Pyxis Technician to train AI models by evaluating their logic and improving their performance. This role requires expertise in healthcare, covering areas such as Revenue Cycle Management, Pharmacy Operations, and Clinical Support... 
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    Washington DC
    4 days ago
  • A healthcare technology company is seeking a Pyxis Technician to join their team in evaluating AI models. The role requires expertise in healthcare, with backgrounds in areas like Revenue Cycle Management, Pharmacy Operations, or Laboratory Services. Responsibilities include... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Oklahoma City, OK
    4 days ago
  •  ...healthcare technology company is seeking a Pyxis Technician to contribute to training AI models. The role involves solving healthcare-related problems for AI chatbots and evaluating their performance. Candidates must be fluent in English and have a degree in a healthcare... 
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    Kansas City, MO
    5 days ago
  • $20 per hour

    A healthcare technology company is seeking a Pyxis Technician to train AI models. The successful candidate will measure chatbot performance, evaluate outputs, and ensure medical accuracy. Ideal candidates possess a healthcare-related degree and fluency in English. This... 
    Hourly pay
    For contractors
    Remote work

    DataAnnotation

    Topeka, KS
    4 days ago
  • A tech company specializing in AI is seeking a Pyxis Technician to join their team. In this role, you will train AI models, provide them with complex healthcare-related problems, and evaluate their performance. Candidates should have expertise in healthcare, including... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Oregon, WI
    4 days ago
  • $20 per hour

    A healthcare technology firm is looking for a Pyxis Technician to help train AI models by evaluating AI outputs for logic and performance. The ideal candidate should have expertise in healthcare and is required to be fluent in English. This role offers flexible work hours... 
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    Sioux Falls, SD
    4 days ago
  • $20 per hour

    A healthcare technology company is seeking a Pyxis Technician to train AI models. The role involves providing complex healthcare-related problems to AI chatbots and evaluating their responses for accuracy and quality. Candidates should have a relevant healthcare expertise... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Providence, RI
    4 days ago
  • $20 per hour

     ...healthcare technology company is seeking a Pyxis Technician to join their team and train AI models. In this role, you will provide healthcare-related problems for AI chatbots and evaluate their logic and performance. Fluency in English and a medical or healthcare-related... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    El Paso, TX
    4 days ago
  •  ...technology company is seeking a Pyxis Technician to join their team remotely. The role involves training AI models by providing healthcare-related problems and evaluating AI outputs for logic and accuracy. Ideal candidates should have healthcare expertise and be fluent in... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    2 days ago
  • A healthcare technology firm is seeking a HIM Analyst to train AI models and evaluate their logic and outputs. This role requires a strong expertise in healthcare and allows for flexible working hours. Responsibilities include providing complex healthcare problems to AI... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Indiana, PA
    2 days ago
  • $20 per hour

    A healthcare tech company is seeking a HIM Analyst to train AI models and ensure their accuracy. The role is fully remote, offering...  ...include providing complex healthcare problems to AI chatbots and evaluating their performance. This is an independent contractor position... 
    Remote job
    Hourly pay
    For contractors

    DataAnnotation

    Louisiana, MO
    2 days ago
  • A healthcare technology company is seeking a Pyxis Technician to join their team to train AI models. The role involves evaluating AI outputs and ensuring medical accuracy. Candidates should possess a healthcare-related degree and be fluent in English. This is a remote independent... 
    Remote job
    Hourly pay
    For contractors
    Flexible hours

    DataAnnotation

    New York, NY
    2 days ago
  • A healthcare technology company seeking a HIM Analyst to train AI models and improve chatbot quality. This position requires expertise...  ...Laboratory Services being relevant. Responsibilities include evaluating AI logic and ensuring medical accuracy. The role offers flexible... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Montgomery, AL
    4 days ago
  • A healthcare technology company based in the United States is seeking a HIM Analyst to train AI models. This role involves measuring the progress of AI chatbots and evaluating their logic to enhance quality. Ideal candidates should have strong healthcare expertise and... 
    Remote job
    Hourly pay
    For contractors
    Flexible hours

    DataAnnotation

    New York, NY
    2 days ago
  • $20 per hour

    A healthcare technology company is seeking a HIM Analyst to join their team for training AI models. This role requires expertise in healthcare and involves evaluating AI outputs, ensuring medical accuracy, and solving complex problems. Positions can be full-time or part... 
    Remote job
    Hourly pay
    Full time
    Part time

    DataAnnotation

    Nevada, IA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Internal Medicine AI Evaluation Specialist. Be the first to apply!