Remote Healthcare AI Evaluation Scientist
$400k24-MAG
New York, NY
- Remote job
24-MAG LLC is seeking experienced medical and healthcare researchers to design rigorous evaluation frameworks for trustworthy healthcare-focused AI systems. You will develop benchmark datasets, validation environments, and analyse medical reasoning to improve AI reliability within clinical workflows. This fully remote, full-time engagement offers compensation in the range of $400,000–$800,000 per year, with opportunities for equity and broader health tech impact across disciplines. #J-18808-Ljbffr 24-MAG
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Remote Healthcare AI Evaluation Scientist in New York, NY vacancy
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI...Remote workContract workSummer workWork at officeMercor
Houston, TXa month ago- Tunnell Government Services, Inc. seeks a Healthcare AI Evaluation and Risk Assessment Specialist to support FDA's oversight of AI-enabled medical devices. The role focuses on evaluating safety, effectiveness, risk management, and evidence across clinical specialties....Remote job
- ...Planet Pharma is seeking experienced healthcare operations professionals to evaluate frontier AI models handling the business side of healthcare. You will design... ..., and author physician queries. This fully remote role emphasizes clear written reasoning and structured...Remote work
Planet Pharma
San Francisco, CA7 hours ago $219k - $246k
...purpose-built to power AI-enabled precision... ...technology, data science, and healthcare, Verily transforms... ...As an AI Applied Scientist, you will occupy a unique... ...Develop automated evaluation pipelines and \"LLM-as... ...challenges from clinical and remote settings, ensuring...Remote workFull timeVerily Life Sciences
Eastern, KY2 days ago$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI...Remote workContract workSummer workWork at officeMercor
Houston, TX25 days ago- ...Sr Data Scientist Exceptional care starts with exceptional people. For... ...role is pivotal in driving healthcare innovation through cutting-edge... ...hands-on experience developing, evaluating, deploying, monitoring, or supporting production AI or machine-learning solutions....Remote workWork experience placementLocal areaImmediate start
Ochsner Health
United States1 day ago $130k - $200k
...client is a nine-person AI infrastructure startup... ...failures, traces, evaluations, and human feedback into... ...across financial services, healthcare, and technology. We... ...hiring an AI Research Scientist to advance the... ...be available • Fully remote within the United States...Remote workFull timeH1bRaydar Inc
United States4 days ago$30 - $50 per hour
A tech company is seeking an AI Researcher to support end-to-end research for modern AI systems. This remote role involves designing experiments, defining evaluation protocols, and improving evaluation rigor for large language models. Key responsibilities include developing...Remote jobHourly pay$219k - $246k
...purpose-built to power AI-enabled precision... ...technology, data science, and healthcare, Verily transforms... ...Description As an AI Applied Scientist, you will occupy a... .... Develop automated evaluation pipelines and "LLM-as-... ...from clinical and remote settings, ensuring absolute...Remote workFull time- ...Bilingual Portuguese AI Evaluation Specialist is a remote evaluation track for reviewing portuguese generalist evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback...Remote workHourly payFor contractors10 hours per week
AI Trainer Jobs
New York, NY5 days ago $180k - $260k
...comfort. Role Overview As a Senior AI Scientist at Atria, you will own the development... .... • Design and run rigorous evaluation: held-out clinical benchmarks, comparison... ...modeling work. • Genuine interest in healthcare and the responsibility that comes with...Remote workSummer workFlexible hoursAtria Health and Research Institute
United States5 days ago- ...Prolific is seeking Product Designers and UX Specialists to join our Expert Network, contributing to the training and evaluation of cutting-edge AI models. This role requires expertise in usability, design systems, and user research, providing essential feedback on design...Remote workWork from homeFlexible hours
Prolific
Tucson, AZ2 days ago - ...Prolific is seeking talented Product Designers and UX Specialists to join our Expert Network for training and evaluation of cutting-edge AI models. Candidates should have a relevant educational background and at least one year of experience in design-related fields. Responsibilities...Remote workWork from homeFlexible hours
Prolific
Arizona City, AZ3 days ago $30 per hour
...Prolific is seeking Fluent Korean Speakers to join our Expert Network. You will help train and evaluate AI models by completing paid tasks and passing a quick skills test to join as a participant. You can work from home and earn competitive pay. Researchers paying for...Remote workSelf employmentWork from homeProlific
New York, NY4 days ago$120k - $150k
...Researcher – CMS Innovation Center (CMMI) Evaluations with our Healthcare Innovations team. Our team works... ..., economists, sociologists, data scientists, and public health experts – advance... ...position has the flexibility to work remotely within the United States (U.S.) or from...Remote workFull timeFixed term contractH1bWork at officeLocal area- OpenTrain AI, Inc. is seeking a remote, part-time contractor to develop and evaluate psychiatric materials used to train AI systems. This role blends clinical expertise, Malay cultural knowledge, bilingual writing, and careful review of sensitive mental health content....Remote jobPart timeFor contractors
- A healthcare consulting firm in Colby, Kansas, is seeking a Nurse Practitioner or Physician Assistant to conduct examinations for veteran compensation evaluations. Responsibilities include conducting assessments, reviewing medical histories, and completing reports, all...Remote jobWork from homeFlexible hours
$130k - $160k
...With human-centered, healthcare-relevant, and value-based... ...Implementation and Evaluation plays a pivotal role... ...with economists, data scientists, and engineers to conduct... .... This is a remote position. Occasional travel... ...6-4920 or ****@*****.***.ai. Please note that unless...Remote workFull time- AI Trainer Jobs seeks a Generalist (Macbook User) to remotely evaluate prompts and responses against AuraOne's rubric. You will compare paired outputs, label edge cases, and draft structured feedback for retraining. Role involves reviewing frontier model outputs, judging...Remote job
$20 per hour
A leading AI development company in the United States is seeking detail-oriented individuals for remote opportunities in training AI chatbots. Responsibilities include developing... ..., writing high-quality responses, and evaluating AI outputs. The ideal candidates are fluent...Remote workHourly payFlexible hoursSupportFinity
United States5 days ago- A leading AI research accelerator is seeking Geospatial Experts to enhance AI systems through evaluations and real-world applications. This entry-level contractor position is fully remote with flexible hours, primarily focusing on geospatial reasoning tasks. Responsibilities...Remote jobFor contractorsFlexible hours
- A leading research accelerator is seeking a Geospatial Expert to enhance AI systems through advanced geospatial analysis. This entry-level, remote role involves evaluating geospatial datasets and supporting tasks aligned with crisis management and agriculture. Candidates...Remote jobContract work
- AI Trainer Jobs in the United States is seeking a remote HR Documents Specialist (Korean) to review prompts and responses against AuraOne's quality rubric. Reviewers... ...to retrain the model. You will help turn Korean evaluation outputs into auditable labels, rationales, and...Remote job
- AI Evaluation SpecialistRole Type: ContractorLocation: Remote — US, Canada, UK, Ireland, Australia, New ZealandWe are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project.You'll evaluate...Remote job
- AI Trainer Jobs in the United States is seeking a C++ Systems Programming AI Evaluator to remotely review prompts and responses against our quality rubric. You will compare outputs, label edge cases, and provide structured feedback for retraining. This independent contractor...Remote jobHourly payFor contractors10 hours per week
- Judi Health is hiring a Senior Applied AI/ML Scientist to lead the development and optimization of Large Language Models (LLMs) aimed at transforming healthcare. The successful candidate will engage in research and development, focusing on advanced AI/ML solutions to enhance...Remote job
$30 - $90 per hour
...Role Overview Help improve enterprise AI assistants by evaluating their outputs, identifying weaknesses, and delivering feedback that strengthens... ...matter expertise and careful judgment are central to this remote contract role. Prior AI experience is not required. Key...Remote workHourly payContract workFor contractorsSaidGig
United Kingdoma month ago- .... About the Role We are looking for Data Scientists and Quantitative Professionals to help evaluate and improve next-generation AI models. You will assess AI-generated solutions... ...: Strong written English LOCATION: Remote — English-speaking countries Key Responsibilities...Remote workUnited States1 day ago
- A forward-thinking tech company is seeking an AI Trainer specializing in visual and graphic design to evaluate AI outputs. Responsibilities include assessing design... ...with design tools like Figma and Adobe. This remote role offers the chance to impact AI development while...Remote workFlexible hours
Prolific
San Francisco, CA7 hours ago $20 - $60 per hour
...Contribute research-driven evaluation content that helps improve next-generation AI systems. This remote contract role centers on creating challenging questions, researching defensible answers, testing model performance, and refining content to probe advanced reasoning...Remote workHourly payContract workFor contractorsSaidGig
United Statesa month ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Healthcare AI Evaluation Scientist. Be the first to apply!
Related searches
- ai scientist New York, NY
- ai data scientist New York, NY
- c++ remote New York, NY
- senior devops engineer remote New York, NY
- remote .net full stack web developer New York, NY
- nursing recruiter (remote) New York, NY
- agile coach / scrum master (remote) New York, NY
- clinical data coordinator remote New York, NY
- pmp - project manager - remote New York, NY
- part time project manager remote New York, NY