Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote Medical AI Evaluation Specialist

YO AI Labs

Seattle, WA
  • Remote job

YO AI Labs seeks Medical Evaluation Specialists, including medical students, residents, physicians, and biomedical professionals, to contribute clinical expertise to evaluating and improving next‑generation AI systems. In this contractor role, you will create and validate challenging medical questions and answers to test AI systems' ability to interpret evidence, synthesize information, and apply clinical judgment. #J-18808-Ljbffr YO AI Labs

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Remote Medical AI Evaluation Specialist in Seattle, WA vacancy
  • $141.02k - $204.53k

     ...City Rochester State MN Remote NO Department Information Technology...  ...Clinic. Benefits Highlights Medical: Multiple plan options. Dental:...  ...As the Senior AI/ML Engineer - Validation & Evaluation within AI Validation & Monitoring (... 
    Remote work
    Medical
    Full time
    Work at office
    Flexible hours
    Weekend work

    Mayo Clinic

    Rochester, MN
    26 days ago
  •  ...technical talent with leading AI research labs. Headquartered in...  ...Image Interpretation & AI Evaluation Type: Contract Compensation...  ...: $270/hour Location: Remote Role Responsibilities...  ...dermatological images using precise medical terminology across diverse... 
    Remote work
    Medical
    Contract work
    Summer work

    Mercor

    New York, NY
    14 days ago
  • $30 - $90 per hour

     ...Role Overview Help improve enterprise AI assistants by evaluating their outputs, identifying weaknesses, and delivering feedback that strengthens...  ...matter expertise and careful judgment are central to this remote contract role. Prior AI experience is not required. Key... 
    Remote work
    Hourly pay
    Contract work
    For contractors

    SaidGig

    Remote
    23 days ago
  •  ...Prolific is seeking talented Product Designers and UX Specialists to join our Expert Network for training and evaluation of cutting-edge AI models. Candidates should have a relevant educational background and at least one year of experience in design-related fields. Responsibilities... 
    Remote work
    Work from home
    Flexible hours

    Prolific

    Arizona City, AZ
    4 days ago
  •  ...Prolific is seeking Product Designers and UX Specialists to join our Expert Network, contributing to the training and evaluation of cutting-edge AI models. This role requires expertise in usability, design systems, and user research, providing essential feedback on design... 
    Remote work
    Work from home
    Flexible hours

    Prolific

    Tucson, AZ
    3 days ago
  • $8 - $65 per hour

     ...Healthcare Specialist (Fluent in French) - Freelance AI Trainer Project Switzerland Are...  ...patient education, and medical research. With high-quality...  ...prompt engineering and evaluation metrics. A master's...  ...Contract Workplace type: Remote Seniority level: Mid-Senior... 
    Remote work
    Medical
    Hourly pay
    Contract work
    For contractors
    Freelance
    Immediate start

    Meridial

    United States
    2 days ago
  • $20 per hour

    A leading AI development company in the United States is seeking detail-oriented individuals for remote opportunities in training AI chatbots. Responsibilities include developing...  ..., writing high-quality responses, and evaluating AI outputs. The ideal candidates are fluent... 
    Remote work
    Hourly pay
    Flexible hours

    SupportFinity

    United States
    1 day ago
  • micro1 is seeking an AI Evaluation Specialist to assess AI outputs for an enterprise training initiative. You will evaluate responses against rubrics...  ...help refine evaluation criteria to improve model quality. Remote contractor role with emphasis on independence and attention... 
    Remote job
    Contract work
    For contractors

    micro1

    New York, NY
    3 days ago
  • $80 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...: $80/hour Location: Remote Role Responsibilities Oversee...  ...with coding guidelines. Evaluate AI-generated coding...  ...~5+ years of experience in medical coding. At least 2 years in a... 
    Remote work
    Medical
    Contract work
    Summer work

    Mercor

    New York, NY
    5 days ago
  • $20 - $160 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour Location: Remote Role Responsibilities Evaluate the relevance... 
    Remote work
    Contract work
    Summer work

    Mercor

    New York, NY
    5 days ago
  • $30 per hour

    Prolific is seeking Advanced Dutch Speakers in Chicago, IL to train AI models. You will complete AI tasks and assess AI performance in...  ...competitive rates and direct payment through PayPal. Pass the evaluation, and you can start within 15 minutes. #J-18808-Ljbffr Prolific
    Remote job
    Work from home

    Prolific

    Chicago, IL
    2 days ago
  • $20 - $80 per hour

     ...Role Overview Help improve next-generation AI systems by supplying precise, real-world evaluation, annotation, and feedback. This remote contractor role focuses on how AI models learn, reason, and perform across diverse subject areas. Key Responsibilities Evaluate... 
    Remote work
    Hourly pay
    Contract work
    For contractors

    SaidGig

    United States
    more than 2 months ago
  • $121k - $206k

     ...develop, and deploy autonomous AI systems as part of the...  ...time data-driven automation, and evaluation frameworks.Manage technical debt...  ...Maryland, Colorado, Washington and remote workers$133,000.00 - $227,000....  ...off for vacation, illness, medical appointments, and volunteering... 
    Remote work
    Medical
    Full time
    Local area
    3 days per week

    T. Rowe Price

    Washington DC
    4 days ago
  •  ...on-building observation. You will design evaluations that look more like professional exams...  ...work in a regulated domain, legal tech, medical records, or building systems. Familiarity...  ...little as you like. Hybrid by default, fully remote considered for the right candidate. #J... 
    Remote work
    Medical
    Work at office
    Day shift

    Aedifice, Inc.

    Eastern, KY
    3 days ago
  • $121k - $206k

     ...York City office or with our AI Engineering squad in Harbor Point...  ..., implementation, testing, evaluation, deployment, observability, and...  ...Maryland, Colorado, Washington and remote workers$133,000.00 - $227,000....  ...off for vacation, illness, medical appointments, and volunteering... 
    Remote work
    Medical
    Full time
    Work at office
    Local area
    3 days per week

    T. Rowe Price

    New York, NY
    11 hours ago
  • $148.5k - $223.9k

     ...SalesforceSalesforce is the #1 AI CRM, where humans with agents...  ...planning, orchestration, and evaluation systems that enable agents to...  ...including: time off programs, medical, dental, vision, mental health...  ...York - New York City Metro - Remote; Washington - Seattle Metro -... 
    Remote work
    Medical
    Full time

    Salesforce

    New York, NY
    4 days ago
  • $145k - $247k

     ...deployment of production-grade agentic AI systems embedded directly into...  ...frameworks, prompt evaluation and iteration, model benchmarking...  ..., Colorado, Washington and remote workers$159,000.00 - $272,000....  ...time off for vacation, illness, medical appointments, and volunteering... 
    Remote work
    Medical
    Full time
    Local area
    Work from home
    3 days per week

    T. Rowe Price

    Owings Mills, MD
    10 hours ago
  • $68.3k

     ...the estate.We are building an AI enablement layer on top of this...  ...you, including:• Immediate medical, dental, vision and prescription...  ...please call (***) ***-****.#LI-Remote #LI-FordCredit #LI-AW2 What...  ...publish the trend monthly.Create evaluations and an evaluation runner for... 
    Remote work
    Medical
    Work experience placement
    Immediate start
    Worldwide
    Flexible hours

    Ford

    Dearborn, MI
    3 days ago
  • $60 per hour

    Prolific is looking for Biology Experts and Life Science Professionals in Las Vegas, NV to evaluate AI-generated science. Successful candidates will work flexibly from home, earning up to $60 per hour for paid tasks. Responsibilities include reviewing scientific data accuracy... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    Las Vegas, NV
    2 days ago
  • $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $90/hour Location: Remote Role Responsibilities Render a reference...  ...RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel... 
    Remote work
    Contract work
    Summer work
    Local area

    Mercor

    San Francisco, CA
    5 days ago
  •  ...seeking an Data Scientist / Applied AI Engineer t to turn data into...  ..., model development and evaluation, and deployment collaborating...  ...BenefitsPaid Health Benefits (Medical Dental Vision)Equity - We're an...  ...fair + compelling and has a 4 year vestFully Remote Work Environment
    Remote work
    Medical

    CyberCoders

    Redwood City, CA
    4 days ago
  • $150k - $170k

     ...About LawPro.ai LawPro.ai is a pioneering legal technology...  ...automates the tedious process of medical record review, generating...  ...experienced AI Engineer to own the evaluation, selection, and continuous...  ...in the company upside ~100% remote within the US, with flexible arrangements... 
    Remote work
    Medical
    Flexible hours

    LawPro.ai, Inc.

    Eastern, KY
    1 day ago
  • $80 per hour

     ...part-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic...  ...and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $80/hour... 
    Remote job
    Part time
    Flexible hours

    Mindrift

    Raleigh, NC
    2 days ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...: $100–$150/hour Location: Remote Role Responsibilities Lead utilisation...  ...planning, and care coordination. Evaluate AI-generated medical necessity determinations, clinical... 
    Remote work
    Medical
    Contract work
    Summer work
    Night shift

    Mercor

    Houston, TX
    5 days ago
  • $80 per hour

    A technology firm is seeking QAs for autonomous AI agents to validate and improve task structures within a new project. Candidates...  ...analytical thinkers with strong attention to detail and experience in evaluating scenarios. This flexible, project-based role offers competitive... 
    Remote job
    Flexible hours

    Mindrift

    Providence, RI
    2 days ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...: $100–$150/hour Location: Remote Role Responsibilities Lead utilisation...  ...planning, and care coordination. Evaluate AI-generated medical necessity determinations and clinical... 
    Remote work
    Medical
    Contract work
    Summer work
    Night shift

    Mercor

    Houston, TX
    5 days ago
  • $60 per hour

     ...contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical and critical...  ...with structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define expected... 
    Remote job
    Part time
    Flexible hours

    Mindrift

    Kansas City, MO
    2 days ago
  • $206.6k

     ...inference systems that serve Zoom's AI models at production scale --...  ...around our offices and remote work environments. The work style...  ...ensure every candidate is evaluated based on skills, experience, and...  ...the interview process due to a medical disability, please submit an Accommodations... 
    Remote work
    Medical
    Full time
    Work at office

    Zoom

    Seattle, WA
    10 hours ago
  • $55 per hour

     ...Job Description Job Description AI Engineer  Remote  Contract position  Pay: $55 per hour + optional medical, dental, vision, 401(k)  Project Overview...  ...Data cleansing  Data monitoring  Train, evaluate, and deploy machine learning models into production... 
    Remote work
    Medical
    Hourly pay
    Contract work

    CEI

    West Chester, PA
    9 days ago
  • Rex.zone is seeking a remote, full-time Senior AI Data Annotation role supporting training-data quality for modern AI/ML systems. You will deliver high-precision human feedback across RLHF, LLM evaluation, prompt evaluation, and QA evaluation to drive measurable model... 
    Remote job
    Full time

    Rex.zone

    Seattle, WA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Medical AI Evaluation Specialist. Be the first to apply!