Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote Clinical AI Evaluator & Task Designer

Planet Pharma

Planet Pharma is seeking experienced clinicians to evaluate frontier AI models in real clinical work. You will design realistic tasks such as SOAP notes, reconciliations, triage decisions, discharge summaries, patient education, or protocols, and run them through frontier AI agents to assess performance against professional standards. You will work with real-world clinical files you assemble yourself, ranging from compact to multi-day scenarios, aiming to push AI to meet expert-level judgments #J-18808-Ljbffr Planet Pharma

Vacancy posted 19 hours ago
Similar jobs that could be interesting for youBased on the Remote Clinical AI Evaluator & Task Designer in San Francisco, CA vacancy
  • Planet Pharma seeks experienced scientists and engineers to design and evaluate frontier AI models on real technical work, from data analysis to design verifications and reporting. Tasks are grounded in authentic practice and checked against professional standards, with... 
    Remote job

    Planet Pharma

    San Francisco, CA
    1 day ago
  • Mercor is seeking Clinical Mental Health Experts to support an AI research initiative that tests realism of simulated clinical conversations. This short-term, fully remote evaluation task lasts up to 30 minutes and invites mental health professionals to apply their clinical... 
    Remote job
    Temporary work

    Mercor

    Houston, TX
    19 hours ago
  • $30 per hour

     ...not just another player in the AI space – we are building the biggest...  ...Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving...  ...and now tackle complex design tasks such as layout, typography, and... 
    Remote work
    Work from home
    Flexible hours

    Prolific

    United States
    5 days ago
  • YO AI Labs is seeking a Creative & Design Specialist for remote, worldwide collaboration on AI-assisted graphic design and UI/UX tasks. The contractor will review AI outputs, provide high-quality human feedback, and annotate data to train better models. The role requires... 
    Remote job
    For contractors
    Worldwide

    YO AI Labs

    Los Angeles, CA
    3 days ago
  • SaidGig seeks a life sciences task designer to help train future AI systems by creating expert-level evaluation tasks from authentic research artifacts. You will craft problems...  ...; strong scientific foundation matters most. Remote contract engagement with payment tied to task... 
    Remote job
    Contract work

    SaidGig

    New York, NY
    5 days ago
  •  ...focused on safeguarding and refining AI systems. This role centers on evaluating clinical precision, safety standards, and...  ...100 company. This position is remote until further notice. Responsibilities...  ...scaling). Previous experience designing, implementing, or participating... 
    Remote work
    Part time
    For contractors
    Work at office
    Local area
    Immediate start
    Monday to Friday
    Flexible hours

    Vaco by Highspring

    Mountain View, CA
    2 days ago
  • DataAnnotation seeks an experienced UI/UX Product Designer - AI Trainer to shape evaluation briefs for frontier AI models on real visual design tasks. This contract role focuses on...  ...works and where approaches break down. Remote work from Evanston, IL with pay per hour... 
    Remote job
    Hourly pay
    Contract work

    DataAnnotation

    Evanston, IL
    2 days ago
  •  ...Mental Health Clinical AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch clinical review. Reviewers grade differential...  ...availability for at least 10 hours per week. Example tasks Grade a model's differential-diagnosis reasoning on a... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    16 days ago
  • Mercor is seeking an Architecture Expert for a remote, part-time contract role. The position involves evaluating AI models focused on visual document understanding within the Architecture domain and authoring tasks with clear rubrics. Collaborate with domain experts to... 
    Remote work
    Contract work
    Part time

    mercor

    San Francisco, CA
    1 day ago
  •  ...HumanSignal is a remote-friendly platform pairing graphic design professionals with AI training projects. We’re seeking designers to rate and edit design samples, helping AI models learn what makes visuals effective. You’ll rate typography, color, layout, and hierarchy... 
    Remote work
    Freelance

    HumanSignal

    United States
    3 days ago
  • Hippocratic AI Inc. is seeking a Registered Nurse with 5+ years of clinical experience to join our remote data annotation team evaluating AI-driven clinical agents. You will review agent conversations across primary care, chronic disease management, and scheduling, labeling... 
    Remote job

    Hippocratic AI Inc.

    Brooklyn, NY
    4 days ago
  • $20 per hour

    A leading AI technology firm is seeking a Graphic Design Expert to evaluate graphic design elements for AI model training. This part-time contract role offers remote work flexibility and requires expertise in design principles. Ideal candidates should have formal training... 
    Remote job
    Contract work
    Part time

    HumanSignal

    Austin, TX
    2 days ago
  •  ...Job Title: Clinical Content Designer/Business Analyst Location: Remote Duration : Long Term MUST HAVE EXPERIENCE...  ...SKILL SETS - Assess current AI environment and available tools...  ...- Exchange with COL-BO team to evaluate GCD needs over time (per function... 
    Remote work

    Stellent IT LLC

    Remote
    3 days ago
  • DataAnnotation seeks an E-Commerce Web Designer - AI Trainer to craft realistic design briefs, test AI tools, and...  ...outputs against professional UI/web standards. This remote contract role in New York involves evaluating design prompts, comparing model versions, and... 
    Remote work
    Contract work

    DataAnnotation

    New York, NY
    5 days ago
  • DataAnnotation is hiring an experienced Digital Web Designer - AI Trainer for flexible, contract-based work from Evanston, IL, with remote options. You will craft realistic UI/UX...  ...with rigorous design criteria. You will evaluate interfaces, compare model versions, and... 
    Remote job
    Contract work
    Flexible hours

    Designer Jobs

    Evanston, IL
    5 days ago
  • Partner Company, a remote-first AI research initiative, seeks a senior animator-evaluator to assess AI-generated performances and establish rigorous evaluation standards for realism. You will define benchmarks and rubrics, then apply them to character animation, facial... 
    Remote job

    Partner Company

    New York, NY
    2 days ago
  • Volga Partners is seeking an experienced Senior Investment Research & Capital Markets SME to support the development, evaluation, and improvement of AI models. This is not a traditional Investment Banking position; you will assess AI-generated financial analyses, validate... 
    Remote job
    Bank staff

    Volga Partners

    New York, NY
    2 days ago
  •  ...a US-based platform connecting physicians with AI evaluation projects, seeks practicing MDs or DOs to assess clinical EHR vignettes for our medical AI evaluation program...  ...internal medicine. Projects are part-time and task-based, with compensation paid per accepted task.... 
    Part time

    Mindrift

    Austin, TX
    5 days ago
  • AuraOne is seeking a remote VFX Artist / 3D Animator reviewer to evaluate AI outputs for 3D design workflows. You will assess craft, constraints, and tooling adherence, flag production-readiness issues, and document corrections to train the modeling team. This is a contractor... 
    Remote job
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    3 days ago
  • $91.7k - $163.7k

    Optum’s Clinical Experience team is building complex, end-to-end product...  .... In this role, you will lead design execution across responsive...  ...practical designs. The focus includes AI-enabled and agentic...  ...solving efforts Location and remote work Location: Eden Prairie, MN... 
    Remote work
    Full time
    Work experience placement
    Work at office
    Local area

    UnitedHealth Group

    Eden Prairie, MN
    1 day ago
  • $91.7k - $163.7k

     ...through people-led, responsible AI while Caring. Connecting....  ...technology, and operations to design, build, and scale product-centric...  ...business outcomes. Within EDPO, our Clinical Experience team is focused on...  ...enjoy the flexibility to work remotely * from anywhere within the U.S... 
    Remote job
    Minimum wage
    Full time
    Work experience placement
    Work at office
    Local area

    UnitedHealth Group

    New York, NY
    4 days ago
  • $150 per hour

     ...technical talent with leading AI research labs....  ...0/hour Location: Remote Role Responsibilities...  ...criteria by breaking clinical questions into discrete...  ...model response grading. Evaluate clinical dialogues...  ...education Grading-criteria design or clinical guideline... 
    Remote work
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    16 days ago
  • $100 - $160 per hour

    • $100–$160 per hour equivalent, paid per accepted task • 100% remote • Part-time • Fully flexible schedule Work on the cutting edge of legal AI, on your own schedule, and get paid for the litigation judgment you already have. The AI systems everyone is talking... 
    Remote work
    Hourly pay
    Part time
    For contractors
    Flexible hours

    OpenTrain AI

    United States
    20 hours ago
  • YO AI Labs is seeking a Creative & Design Specialist (Contractor) to support projects across graphic design, multimedia production, UI/UX, and motion graphics. You will review AI-generated outputs, provide high-quality human feedback, and help refine creative workflows... 
    Remote job
    For contractors

    YO AI Labs

    Seattle, WA
    2 days ago
  •  ...Digital Designer We're Heidi. We're building the future of healthcare by...  ...every clinician the earth's finest AI Care Partner. In just 18 months, our clinical AI products have absorbed the administrative...  ...love. Now, we're expanding. Every task a clinician hands to Heidi is a... 
    Remote work
    Freelance
    Live in
    Home office
    Flexible hours

    Heidi Health

    United States
    3 days ago
  • $65 per hour

     ...nurses in Las Vegas, NV, to assist in training AI models. You will review AI responses, rate...  ...verified registered nurses, have recent clinical experience, and possess strong attention...  ...and you can earn up to $65 per hour on a task basis, working from home with flexible hours... 
    Hourly pay
    Self employment
    Work from home
    Flexible hours

    Prolific

    Las Vegas, NV
    3 days ago
  • Prolific is seeking Product Designers and UX Specialists to join our Expert Network, contributing to the training and evaluation of cutting-edge AI models. This role requires expertise in usability, design systems, and user research, providing essential feedback on design... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    Tucson, AZ
    5 days ago
  • Prolific is seeking talented Product Designers and UX Specialists to join our Expert Network for training and evaluation of cutting-edge AI models. Candidates should have a relevant educational background and at least one year of experience in design-related fields. Responsibilities... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    Arizona City, AZ
    5 days ago
  •  ...AI Benchmark and Task Designer is a remote review track for evaluating AI outputs across ai benchmark and task designer creative review workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    27 days ago
  • MEDvidi, Inc. ищет Staff Product Designer для руководства дизайном AI Track — ключевой линии инструментов ИИ, где провайдеры работают с выводами модели в регулируемом здравоохранении. Вы будете отвечать за полный цикл дизайна от исследования до передачи в разработку. Требуется... 
    Remote job

    MEDvidi, Inc.

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Clinical AI Evaluator & Task Designer. Be the first to apply!