Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Radiologist (MD) — Medical Imaging AI Annotation & Evaluation [Remote]

AuraOne Human Data

Remote
  • Remote job

Radiologist (MD) — Medical Imaging AI Annotation & Evaluation is a remote clinical-review track for evaluating AI outputs that touch radiology. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so the modeling team can close the gap.

Why this role matters

Radiology AI is only useful if a credentialed clinician would sign their name to the output. AuraOne uses licensed and credentialed reviewers to set the bar for clinical reasoning, dosing, and guideline adherence in regulated workflows.

Responsibilities

  • Review AI outputs against current radiology clinical guidelines and standard of care for Radiologist (MD) — Medical Imaging AI Annotation & Evaluation assignments.
  • Grade differential reasoning, dosing, and red-flag handling on a structured rubric.
  • Flag patient-safety issues with severity tags that match clinical-incident taxonomies.
  • Capture the corrected clinical reasoning so the modeling team can train on it.
  • Adjudicate disputed cases against published evidence or specialty guidelines.
  • Maintain reviewer-quality scores in weekly inter-rater calibration cycles.

Qualifications

  • Active or recent license / board certification in radiology or an adjacent specialty for Radiologist (MD) — Medical Imaging AI Annotation & Evaluation work.
  • Hands-on clinical experience reading patient cases and writing structured assessments.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites guidelines, evidence, or standard of care.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Grade a model's differential-diagnosis reasoning on a radiology case and write a 2-3 sentence assessment.
  • Flag a dosing miscalculation with the right severity tag and corrected dose.
  • Adjudicate a disputed case between two reviewers using current specialty guidelines.
  • Audit a 25-case batch for rubric consistency and report drift to the program lead.

Nice to have

  • Prior work as a guideline reviewer, peer reviewer, or clinical educator.
  • Familiarity with AI-assisted clinical decision support and its failure modes.
  • Bilingual clinical experience for non-English patient cases.

Skills

  • Clinical reasoning
  • Guideline review
  • Patient-safety assessment
  • Structured clinical writing
  • Radiology

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

$200–$400 / hr

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Radiologist (MD) — Medical Imaging AI Annotation & Evaluation [Remote] in Remote vacancy
  •  ...Operations Featured Jobs Special Referral Radiologists: Medical Image Review for AI Benchmarks Remote — United States...  ...medical imaging specialists to evaluate clinical cases and build scoring rubrics...  ...Holds a Doctor of Medicine (MD) or Doctor of Osteopathic Medicine (... 
    Medical
    Contract work
    For contractors
    Remote work
    Shift work

    Remolity, Inc.

    New York, NY
    2 days ago
  • DataAnnotation is seeking an experienced Radiologist or imaging technologist to help train AI models by evaluating and documenting imaging studies (chest X-rays, ultrasound, nuclear medicine). You will review de-identified studies, provide structured impressions, and note... 
    Medical
    Remote job
    Flexible hours

    DataAnnotation

    White Plains, NY
    2 days ago
  • Biz Tech Consultants seeks a radiologist evaluator for AI-driven quality assessments. You will review diagnostic reports, ensure accuracy and alignment with guidelines, and annotate on structured evaluation tasks. Requirements include MBBS with radiology qualification... 
    Suggested
    Remote work

    Biz Tech Consultants

    New York, NY
    3 days ago
  • Remolity, Inc. seeks radiologists to evaluate clinical cases and create scoring rubrics for AI benchmarks. This fully remote role requires interpretation of medical images across multiple modalities and writing...  ...in the United States, with MD/DO credentials, experience in... 
    Medical
    Remote job
    Flexible hours

    Remolity, Inc.

    New York, NY
    2 days ago
  •  ...CHS) in Cardiovascular Imaging The Department of Radiology...  ...Cardiovascular Imaging Radiologist interested in pursuing...  ...intelligence (AI) applications. Members...  ...-Madison's world class medical physics department....  ...members. Education: MD, DO, or equivalent is required... 
    Medical
    Full time
    Traineeship
    Local area
    Remote work
    Day shift

    University of Wisconsin-Madison

    Madison, WI
    4 days ago
  • $50 per hour

     ...specialists with project-based AI opportunities for...  ...companies, focused on testing, evaluating, and improving AI...  ...looking for physicians (MD/DO) with an active, unrestricted US medical license to evaluate clinical...  ...review, or medical annotation/QA (a plus); Strong written... 
    Medical
    Part time
    For contractors
    Remote work
    Flexible hours

    Mindrift

    West Virginia
    1 day ago
  •  ...We are seeking radiologists with a chest/thoracic background to carry out structural annotation on de-identified chest CT scans, with a...  ...the development of clinical AI imaging models. This is a remote,...  ...clinical AI development and medical imaging, shaping how AI systems... 
    Medical
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    Temporary work
    Part time
    For contractors
    Flexible hours

    aptura

    United States
    1 day ago
  • DataAnnotation is seeking an experienced Radiologist or imaging technologist to train AI models by interpreting diagnostic images and drafting detailed, structured reports. You will assess studies such as chest X-rays, ultrasounds, and CT/MRI, and provide impressions with... 
    Medical
    Remote job

    DataAnnotation

    Bethesda, MD
    2 days ago
  •  ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Larry Summers , and Jack Dorsey . Position: Radiologist (MD) — Medical Imaging AI Annotation & Evaluation Type: Contract Compensation: $200–$400/... 
    Medical
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    24 days ago
  • $120 per hour

     ...you will work as a Radiologist Subject Matter Expert (SME) to review AI-generated radiology and medical-imaging responses and/or create...  ...imaging content, evaluating reasoning quality...  ...cases. Requirements MD/DO (or equivalent)...  ...with AI data training/annotation, report QA, peer... 
    Medical
    Hourly pay
    For contractors
    Local area
    Immediate start
    Remote work

    SuperAnnotate AI

    New York, NY
    4 days ago
  • BREAST IMAGER Position at a Glance: Work Location: UPMC Hamot Address: Erie, PA Status: Full Time Schedule: Monday...  ...research and leading-edge therapies. Qualifications: MD/DO from an accredited medical school American Board of Radiology Certified or Eligible... 
    Medical
    Full time
    Temporary work
    Summer work
    H1b
    Local area
    Remote work
    Work from home
    Overseas
    Relocation package
    Monday to Friday

    UPMC Northwest PA and NY

    Erie, PA
    1 day ago
  •  ...PRN General Radiologists (MD/DO) Medical University of South Carolina Regional Health Network The Department...  ..., supporting comprehensive diagnostic imaging services for a diverse regional...  ...optimization and robust user support AI-enabled documentation and workflow... 
    Medical
    Relief
    Local area
    Remote work
    Weekend work

    Medical University of South Carolina

    Orangeburg, SC
    1 day ago
  •  ...Type: Part-Time Location: Remote Qualifications: Board-certified in Radiology and MD or DO is required. Strong expertise in Radiology and Diagnostic Imaging. Experience interpreting medical images and providing accurate diagnoses. Strong communication and interpersonal... 
    Medical
    Remote job
    Part time
    Work from home
    Day shift

    Aylo Health, LLC

    New York, NY
    2 days ago
  •  ...Body Radiologist At Mount Sinai As Mount Sinai grows, so does our...  ...care. Since 1949, Mount Sinai Medical Center has remained committed...  ...and interpreting diagnostic imaging procedures, encompassing general...  ...Doctor of Medicine (MD) or Doctor of Osteopathic Medicine... 
    Medical
    Remote work

    Mount Sinai Medical Center

    Miami Beach, FL
    3 days ago
  •  ...Breast Radiologist Opportunity The Icahn School of Medicine at Mount...  ...to deliver high quality medical care to the Queens communities...  ...Interpret full range of breast imaging-mammography (including tomosynthesis...  ...Chair. Qualifications MD degree from an Accredited... 
    Medical
    Full time
    Traineeship
    Local area
    Remote work
    Flexible hours

    Mount Sinai Hospital

    New York, NY
    1 day ago
  •  ...in the development to new protocols and imaging techniques. Interprets imaging exams...  ...purposes. Writes notes in the electronic medical record when clinically appropriate....  ...assure effective patient care, discuss evaluation, management, follow-up, and other aspects... 
    Medical
    Permanent employment
    Temporary work
    Work at office
    Local area
    Remote work
    Monday to Friday
    Shift work

    US Department of Veterans Affairs

    Orlando, FL
    4 days ago
  •  ...Radiologist General / Breast Imaging Seeking an on-site, full- or part-time BE/BC radiologist...  ...The Southeast Permanente Medical Group (TSPMG) is one of...  ...Minimum Requirements: MD or DO Board Certified or...  ...electronic health record (Epic) and AI-assistance to streamline... 
    Medical
    Full time
    Part time
    Work from home
    Shift work
    Night shift
    Afternoon shift
    Weekday work

    The South Plains

    Atlanta, GA
    5 days ago
  •  ...Diagnostic Radiologist - Breast/Women's Imaging Location: Naval Medical Center Portsmouth, VA Pay: $250/hr Position Type: Independent Contractor (1099)...  ...Improvement Program. Participate in meetings to review and evaluate the care provided to patients, identify... 
    Medical
    Contract work
    For contractors
    Local area
    Flexible hours
    Shift work
    Night shift
    Afternoon shift
    Weekday work

    Akahi Associates/Kako'o Services, LLC

    Portsmouth, VA
    3 days ago
  • $420k

     ...Department of Radiology and Imaging Sciences by adding several services...  ...thoracic and cardiothoracic radiologists for onsite/hybrid and remote...  ...benefits, including medical and dental insurance, life insurance...  ...Doctor of Medicine (MD) or Doctor of Osteopathy (DO)... 
    Medical
    Full time
    Part time
    For contractors
    Local area
    Immediate start
    Remote work
    Visa sponsorship
    Relocation package
    Flexible hours
    Shift work
    Weekend work

    Highmark Blue Cross Blue Shield of Western New York

    Pittsburgh, PA
    2 days ago
  • Mindrift is seeking US-licensed physicians (MD/DO) to evaluate clinical EHR vignettes for an AI evaluation project. You will review cases, score diagnostic and treatment decisions, and write concise rationales. This is a flexible, time-limited, contractor opportunity with... 
    Medical
    Remote job
    For contractors
    Flexible hours

    Toloka

    Annapolis, MD
    5 days ago
  •  ...applicant will provide coverage for the Musculoskeletal Imaging services and will participate in clinical service, medical student and resident teaching and research...  ...(s) and may include drug screening, medical evaluation clearance and functional capacity assessment. This... 
    Medical
    Remote job
    Contract work
    Temporary work
    Zero hours contract
    Local area
    Shift work

    University of California, Davis

    Sacramento, CA
    1 day ago
  • Mindrift (Toloka) is seeking US-licensed physicians to evaluate clinical EHR vignettes for a medical AI evaluation project. You will review written cases,...  ...participation and onboarding rewards. Ideal candidates hold an MD/DO with active license, broad multi-system experience,... 
    Medical
    Remote job
    For contractors
    Flexible hours

    Mindrift (Toloka)

    New York, NY
    2 days ago
  • $420k

     ...talented Physicians within the AHN Imaging Institute! Allegheny Health...  ..., we are implementing AI-enhanced reporting and image interpretation...  ...teaching to the residents and medical students is desired. ~ Active...  ...Doctor of Medicine (MD) or Doctor of Osteopathy (DO)... 
    Medical
    Remote job
    Full time
    Part time
    For contractors
    Local area
    Immediate start
    Relocation package
    Weekend work

    Highmark Blue Cross Blue Shield of Western New York

    Pittsburgh, PA
    2 days ago
  •  ...Body Imaging Radiologist And Section Chief Oregon Health & Science University (OHSU) Department...  ...Development and Mentorship Coach, evaluate, and lead faculty; support promotions;...  ...with referring surgical and medical subspecialists. The OHSU radiologist team... 
    Medical
    Full time
    Temporary work
    Traineeship
    Remote work
    Relocation package
    Flexible hours
    Night shift

    Disabledperson, Inc

    Portland, OR
    1 day ago
  •  ...Tinley Park, IL Employer: Rhino Medical Pay: Competitive weekly pay...  ...Park, Illinois Diagnostic Radiologist Locum Tenens Opportunity Remote Diagnostic Imaging Coverage • Body, Neuro, and Breast...  ...Certified in Radiology MD degree Preferred Qualifications... 
    Medical
    Weekly pay
    Full time
    Contract work
    Locum
    Immediate start
    Remote work

    Rhino Medical

    Tinley Park, IL
    23 hours ago
  •  ...Breast Imaging Radiologist - No Nights | No Weekends | No Call Join a high-performing Breast...  ...streamlined workflow Qualifications: MD/DO BC/BE Diagnostic Radiology...  ...Health DePaul Hospital offers comprehensive medical care, with all private rooms in a convenient... 
    Medical
    Local area
    Work from home

    SSM Health

    Bridgeton, MO
    2 days ago
  • $347k

     ...An exclusive opportunity awaits a skilled Radiologist to join an established, patient-centered imaging practice serving Southern California’s San...  ...patient safety initiatives. Qualifications MD or DO from an accredited medical institution. Completion of an ACGME-... 
    Medical
    Full time
    Immediate start
    Remote work
    Shift work

    Lancesoft Inc

    California
    1 day ago
  •  ...LaGrange, GA Employer: Rhino Medical Pay: Competitive weekly pay...  ...LaGrange, Georgia Diagnostic Radiologist Locum Tenens Opportunity Remote Diagnostic Imaging Coverage • CT, X-ray, Ultrasound...  ...Tech Stack Requirements MD degree Georgia medical license... 
    Medical
    Weekly pay
    Full time
    Contract work
    Locum
    Immediate start
    Remote work
    Shift work
    Night shift
    Weekend work
    Day shift
    Afternoon shift

    Rhino Medical

    Lagrange, GA
    23 hours ago
  •  ...Greensboro, NC Employer: Rhino Medical Pay: Competitive weekly...  ..., North Carolina Diagnostic Radiologist Locum Tenens General or...  ...and emergency diagnostic imaging, including CT, MRI, CR, and US...  ...Carolina medical license MD degree Board Certified in... 
    Medical
    Weekly pay
    Full time
    Contract work
    Locum
    Immediate start
    Remote work
    Monday to Friday
    Flexible hours
    Shift work
    Weekday work

    Rhino Medical

    Greensboro, NC
    23 hours ago
  •  ...Hudson, FL Employer: Rhino Medical Pay: Competitive weekly...  ..., Florida Interventional Radiologist Locum Tenens Opportunity Trauma...  ...IR procedures and diagnostic imaging support • Flexible remote...  ...Florida medical license MD degree Board Certified or... 
    Medical
    Weekly pay
    Full time
    Contract work
    Locum
    Immediate start
    Remote work
    Monday to Friday
    Flexible hours

    Rhino Medical

    Hudson, FL
    23 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Radiologist (MD) — Medical Imaging AI Annotation & Evaluation [Remote]. Be the first to apply!