Remote Medical AI Evaluation Specialist
Temporary
YO AI Labs
YO AI Labs seeks Medical Evaluation Specialists, including medical students, residents, physicians, and biomedical professionals, to contribute clinical expertise to evaluating and improving next‑generation AI systems.
In this contractor role, you will create and validate challenging medical questions and answers to test AI systems' ability to interpret evidence, synthesize information, and apply clinical judgment.
#J-18808-LjbffrVacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Remote Medical AI Evaluation Specialist in Seattle, WA vacancy
$141.02k - $204.53k
...City Rochester State MN Remote NO Department Information Technology... ...Clinic. Benefits Highlights Medical: Multiple plan options. Dental:... ...As the Senior AI/ML Engineer - Validation & Evaluation within AI Validation & Monitoring (...Remote workMedicalFull timeWork at officeFlexible hoursWeekend workMayo Clinic
Rochester, MN8 days ago- ...What Is An Ai Evaluation Specialist? An AI evaluation specialist assesses and tests artificial intelligence systems to ensure they perform... ...an AI evaluation specialist is typically an office-based or remote environment where they spend much of their time working with...Remote workWork at office
Valence
United States15 hours ago $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Compensation: $120–$200/hour Location: Remote Role Responsibilities Evaluate complex technical tasks using deep language expertise...Remote workHourly payWeekly payFull timeContract workFor contractorsSummer workMercor
Remote10 hours ago- AI Solutioning ConsultantDo you have experience... ...and user experiences.Evaluating solution options across... ...integration teams, and data specialists.Ensuring solutions are... ...working patterns:Remote Work - Regular... ...activitiesComprehensive private medical care optionsSafety net...Remote workMedicalFull timeFlexible hours
$155k - $190k
...About Arize AI is rapidly transforming the world. As generative... ...Engineering observability and evaluation platform , empowering AI... ...relationships. While we are a remote-first company, the nature of... ...comprehensive benefit package, including: medical, dental, vision, 401(k) plan,...Remote workMedicalFull timeWork experience placementWork from homeArize Ai
Remote10 hours ago$8 - $65 per hour
...Healthcare Specialist (Fluent in French) – Freelance AI Trainer Project Large‑scale language... ...patient education, and medical research. With high‑quality... ...prompt engineering and evaluation metrics. Qualifications... ...Contract Workplace type: Remote Seniority level: Mid‑Senior...Remote workMedicalHourly payContract workFor contractorsFreelanceMeridial
Cedar Grove, WI3 days ago- ...AI Trainer Position MCI is one of the fastest-growing tech-... ...are powered by both on-site and remote agents, leveraging advanced... ...This role is responsible for evaluating AI outputs, creating training... ...age, ancestry, color, family or medical care leave, gender identity or...Remote workMedicalWork at officeLocal area
AI Support Positions
United States5 days ago $170k - $200k
...Role The Senior AI Engineer builds and deploys production-grade... ...and performance Evaluate, test, and improve agent behavior... ...needed Location Full-time, remote (US-based) Quarterly on-sites... ...Holidays ~ Employer sponsored Medical, Dental, & Vision plans ~$1,...Remote jobMedicalFull timeLocal areaFlexible hoursAcquisition.com
United States10 hours ago$80 per hour
...part-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic... ...and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $80/hour...Remote workPart timeFlexible hoursMind Rift
United States3 days ago- ...What you will do The AI Vision Systems Specialist is responsible for designing, developing... .... This position is remote with possible relocation... ...Leadership & Documentation Evaluate and select hardware/... ...REQUIRED What you get: Medical, dental and vision care coverage...Remote workMedicalTemporary workFor contractorsWork experience placementLocal areaWorldwideRelocationFlexible hoursGlendale, WI5 days ago
$200k - $220k
...is the only company applying AI Digital Twin technology exclusively... ...reduced or even eliminated medications, all while living healthier,... ...quality of the AI system — evaluation frameworks, testing, CI... ...engineering best practices. ~ This remote opportunity is available to...Remote jobMedicalFull timeFlexible hoursTwin Health
United States10 hours ago$200k - $300k
...Farsight Farsight is the agentic AI platform for financial... ...week (except Fridays, which are remote). Job Description As an AI Engineer... ...polished output. Build the evaluation and quality systems behind... ...with experience. Comprehensive medical, dental and vision insurance...Remote workMedicalFull timeLocal areaFarsight Ai
Manhattan, KS10 hours ago$30 - $90 per hour
...Role Overview Help improve enterprise AI assistants by evaluating their outputs, identifying weaknesses, and delivering feedback that strengthens... ...matter expertise and careful judgment are central to this remote contract role. Prior AI experience is not required. Key...Remote workHourly payContract workFor contractorsSaidGig
United Kingdom5 days ago$135k - $200k
...The Role Forward Deployed AI Engineers work directly with... ...foundation in Machine Learning basics (Evaluation, Training, Problem... ...eligible dependents) can enroll in medical, dental, and vision insurance... ...are a few roles that allow for “Remote” work on an exceptional basis....Remote workMedicalFull timeWork experience placementWork at officeWork from homeRelocation packageFlexible hoursPalantir Technologies
New York, NY10 hours ago$8 - $65 per hour
...Healthcare Specialist (Fluent in French) - Freelance AI Trainer Project Switzerland Are... ...patient education, and medical research. With high-quality... ...prompt engineering and evaluation metrics. A master's... ...Contract Workplace type: Remote Seniority level: Mid-Senior...Remote workMedicalHourly payContract workFor contractorsFreelanceImmediate startMeridial
United States4 days ago- ...Worth AI is hiring a Senior Agentic AI Engineer to design and... ...golden sets, offline and online evaluations, used to make ship/no-ship calls... ...engineering. All Remote Hires will be required to travel... ...Orlando. ~ Health Care Plan (Medical, Dental & Vision) ~...Remote jobMedicalFull timeFlexible hours
Worth Ai
Orlando, FL10 hours ago $25 - $30 per hour
...Bilingual German AI Evaluation Specialist is a remote German specialist track for evaluating german evaluation outputs against native-speaker standards. Reviewers spot fluency, register, and cultural-context errors that automated checks miss, and write structured rationale...Remote workFor contractors10 hours per weekAuraOne Human Data
Remotea month ago- ...About Sully.ai Sully.ai is building the... ...changing that with AI medical employees: Scribes, Receptionists... ...do Build and scale evaluation systems Design and... ..., parallel specialists, dynamic output contracts... ...Location: Open to US remote, but ideally office based...Remote workMedicalFull timeWork at officeNight shift
Sully.ai
Remote10 hours ago - ...Join a pioneering AI initiative focused on building next-generation evaluation benchmarks for frontier AI models. We are seeking analytical and technically skilled... ...state-of-the-art AI systems. This is a fully remote, full-time engagement requiring approximately 35 hours...Remote workFull timeContract workFor contractorsFlexible hours
Weekday
Remotea month ago - ...has built the first-to-market AI native coaching platform for enterprise... ...to advance product goals. Evaluate and improve existing... ...Comprehensive health coverage (medical, dental, and vision) from day... ...offices, otherwise this role can be remote. Candidates must be...Remote workMedicalFull timeWork at officeWork from home
Valence
New York, NY10 hours ago - ...In 2025, we started Handshake AI and built the fastest-growing... ...AI lab researchers to create evaluations, publish benchmarks, and push... ...parental coaching Wellbeing: Medical, dental, and vision, mental... ...stipend, ongoing development Remote & Office: Internet, commuting...Remote workMedicalFull timeWork at officeFlexible hours
Handshake
Remote10 hours ago $180k - $200k
...Total Rewards philosophy . AI is a fundamental part of how... ...AI at Gusto, including robust evaluation frameworks (evals), guardrails... ...$200,000/yr in Denver & most remote locations, $220,000/yr to $245... ...pregnancy, childbirth, or related medical conditions), marital status,...Remote workMedicalFull timeWork at officeLocal area2 days per week3 days per weekGusto
New York, NY10 hours ago- ...About Orum Orum ’s AI-powered suite frees salespeople to do what... .... As a company, we are a remote-first team of builders and dreamers... ...AI use cases Establish evaluation, monitoring, and feedback... ...pregnancy, childbirth, or related medical conditions), sexual orientation...Remote jobMedicalFull time
Orum
San Francisco, CA10 hours ago $128.3k - $176.4k
...situations or data requires an in-depth evaluation of variable factors.The Senior AI Software Engineer standardizes the... ....Travel: While this is a remote position, occasional travel to Humana... ...Among our benefits, Humana provides medical, dental and vision benefits, 401(k)...Remote workMedicalFull timeTemporary workApprenticeshipWork at officeWork from homeHome office- ...programs ~ Excellent medical, dental, vision, and... ...We are seeking a Lead AI Engineer to join our Business... ...may be able to work remotely from anywhere within... ...patterns, evaluation and audit. As the team... ...Manager and AI Operations Specialists will join to take on intake...Remote workMedicalFull timeWorldwideFlexible hours
Afl
Remote10 hours ago - ...mental healthcare. Rula is a remote-first company. We currently... ...Rula, this role owns the applied AI and ML solutions that... ...data pipelines, and rigorous evaluation systems (offline metrics like... ...Comprehensive health benefits : Medical, dental, vision, life, disability...Remote workMedicalFull timeLive inCurrently hiringImmediate startHome office
Rula
Los Angeles, CA10 hours ago $105.59k - $142.86k
...shaping the future of technology.AI Enablement EngineerJob... ...will support the identification, evaluation, development, and deployment of... ...applicable eligibility requirements:Medical, Dental, Vision and Disability... ...a mix of in-office and remote work, depending on the nature...Remote workMedicalFull timeWork at officeWorldwideFlexible hours$103.15k - $158.59k
Hybrid Remote • Houston, TX • Data Science Job TypeFull-timeDescriptionFervo... ...Scaling that mission requires AI-native capabilities that drive... ..., through prototyping, evaluation, deployment, and iteration in... ...suite of benefits including medical, dental, vision, life, short-...Remote workMedicalTemporary workWork at officeLocal areaFlexible hours$197.3k - $313.7k
...SalesforceSalesforce is the #1 AI CRM, where humans with agents... ...person, we would consider a fully remote employee**Please only apply if... ...new interaction models, evaluate them against technical constraints... ...including: time off programs, medical, dental, vision, mental health...Remote workMedicalFull timeShift work$20 per hour
A leading AI development company in the United States is seeking detail-oriented individuals for remote opportunities in training AI chatbots. Responsibilities include developing... ..., writing high-quality responses, and evaluating AI outputs. The ideal candidates are fluent...Remote workHourly payFlexible hoursSupportFinity
United States1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Medical AI Evaluation Specialist. Be the first to apply!
Related searches
- medical records specialist Seattle, WA
- medical management specialist Seattle, WA
- medical information specialist Seattle, WA
- overnight pct Seattle, WA
- patient care associate Seattle, WA
- hca healthcare Seattle, WA
- medical certification specialist Seattle, WA
- health care assistant hospital Seattle, WA
- hca part time Seattle, WA
- health care assistant Seattle, WA