Remote Medical Evaluation Architect for AI Benchmarks
YO AI Labs
- Remote job
YO AI Labs seeks Medical Evaluation Specialists, including medical students, residents, physicians, and biomedical professionals, to contribute clinical expertise for evaluating and improving next-generation AI systems. You will create and validate challenging medical questions and answers to test advanced clinical reasoning, synthesize evidence, and document rationales with citations. This is a remote contractor role emphasizing high-quality medical content. #J-18808-Ljbffr YO AI Labs
- YO AI Labs is seeking Medical Evaluation Specialists to craft and validate challenging medical questions and answers for AI evaluation. Remote contractor role focusing on clinical expertise, literature... ...explanations for AI benchmarks. #J-18808-Ljbffr YO AI LabsRemote jobMedicalFor contractors
- Mercor is hiring experienced medical and health science... ...assessment content for an AI research initiative. You will... ...help establish gold-standard benchmarks for AI evaluation. Role focuses on expert-level... ...10+ hours per week, fully remote, asynchronous collaboration...Remote jobMedical10 hours per week
- ...independent contractor opportunity for physicians, medical researchers, and health science professionals... ...challenging medical questions and establishing rigorous evaluation standards for AI systems. Engagement is fully remote and asynchronous, with a minimum expectation of 1...Remote jobMedicalPart timeFor contractors10 hours per week
$110.6k - $178k
Product Architect - AI & Digital ProductsCome make the world... ...team working as a remote employee. We're building... ...feasibility.Evaluate commercial platforms,... ...Experience evaluating, benchmarking, and optimizing Large... ...benefits plan, including:Medical, dental, life, vision...Remote workMedicalFull timeLocal area- ...Role Overview Evaluate and benchmark the coding abilities of frontier AI models by reviewing AI-generated solutions, validating... ...type: Contractor assignment, no medical or paid leave provided.... ...is next week. Work location: Remote, United States only. Perks: fully...Remote workMedicalContract workFor contractors
- Obsidian is seeking expert medical and health science professionals to... ...academic assessment content for an AI research initiative. You will... ...health and medicine domains, evaluate solution quality, and help establish gold-standard benchmarks for advancing AI capabilities....Remote jobMedical10 hours per week
- ...review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous MCQs across core mathematics domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be...Remote job
- YO AI Labs is seeking Medical Evaluation Specialists to contribute clinical expertise for evaluating and improving next-generation AI systems. You will... ...skills, and clinical reasoning are essential for success in a remote contractor role. #J-18808-Ljbffr YO AI LabsRemote jobMedicalFor contractors
- ...academic assessment content for an AI research initiative. You will write... ...philosophy questions across core domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. This fully remote, asynchronous role requires 10+...Remote job10 hours per week
- Mercor is seeking AI experts for a benchmark dataset project evaluating models on visual document understanding and instruction-following in the Education domain. This remote role offers ~15-20 hours per week with flexible scheduling from the US or Canada. Payments are...Remote jobFlexible hours
- ...academic assessment content for an AI research initiative. You will... ...across core law domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities... ...or Question Verification, with remote collaboration and flexible scheduling...Remote jobFlexible hours
- Mercor seeks contributors for a benchmark dataset project evaluating AI models on visual document understanding and instruction-following in the Architecture domain. This is a fully remote independent contractor role, roughly 15-20 hours per week, available to candidates...Remote jobWeekly payFor contractorsFlexible hours
- YO AI Labs seeks Medical Evaluation Specialists, including medical students, residents, physicians, and biomedical professionals, to contribute clinical expertise to evaluating and improving AI systems. You will create and validate high-difficulty medical questions and...Remote jobMedical
- YO AI Labs is seeking Medical Evaluation Specialists, including medical students, residents, physicians, and biomedical professionals, to contribute clinical expertise to a project evaluating next-generation AI systems. You will create and validate high-difficulty medical...Remote jobMedical
- ...systems, starting with weather. We seek research engineers to design a central evaluation framework and reusable pipelines that span models and teams. You will implement evaluation pipelines, benchmark suites, baselines, and visualization tools to turn results into shared,...
- Vals AI, Inc. in San Francisco is seeking exceptional researchers and research engineers to design and build the next generation of AI benchmarks that evaluate real-world LLM capabilities. You will lead development of novel benchmarks shaping how foundation models are...
- ...in the convergence of AI, automation, agents, people... ....As a Principal AI Architect - Healthcare, you will... ...transformation strategies, evaluate technology investments,... ...networks, academic medical centers, or other complex... ...hybrid, office-based, and remote workers will vary from...Remote workMedicalWork at officeImmediate start
$215k - $300k
...are seeking a Principal Architect to help lead the next generation of AI-enabled product, platform... ..., AI orchestration, evaluations, AI observability, and AI... ...considerations.Location:Remote -Chicago, ILIf this job... ...contributionsComprehensive Medical, Dental & Vision CarePaid...Remote workMedicalFull timeLocal area$136k - $204k
...requires:The Practice Architect, Level 1 is a hands-on... ...governed, production-ready AI solutions. You will... ...include the following: • Medical, Dental, and Vision • Critical... ...TypeThis is a fully remote position.Application... ..., screening, and evaluating candidates. AI helps assess...Remote workMedicalPermanent employmentFull timeTemporary work$136k - $204k
Practice Architect AI/ML ( Full-time, Remote) Think of TEKsystems Global Services (TGS) as the growth solution... ...benefits include the following: • Medical, Dental, and Vision • Critical... ...including sourcing, screening, and evaluating candidates. AI helps assess applications...Remote workMedicalPermanent employmentFull timeTemporary work$147.9k - $254.8k
...AI & Cloud Architect Founded in 1977 as the Senior Care Action Network, SCAN began with a simple... ..., primary care, care for the most medically and socially complex populations, and... ...cloud environments for model training, evaluation, and inference. Oversee vector database...Remote workMedical$275.84k - $344.8k
...Our dedication to remote-first work , and strong... ...Artificial Intelligence (AI) to help make our hiring... ...as Twilio’s next Sr AI Architect - Conversation AI. About... ...capabilities. Evaluate and implement modern LLM... ...decisions, or related medical conditions), sexual orientation...Remote workMedicalLocal areaWorldwide- A leading AI research accelerator is seeking a highly skilled Biomedical Informatics... ...Subject Matter Expert to develop rigorous evaluation questions for advanced AI models. This role... ...or R. The successful candidate will work remotely on cutting-edge AI projects, with a...Remote workContract work
- A top AI research partner is seeking a Biomedical Informatics Subject Matter Expert to develop rigorous evaluation questions for advanced AI models. This role involves designing complex... ...in the field. This position is fully remote and offers the opportunity to work on...Remote work
- A leading AI research accelerator is seeking a Biomedical Informatics Subject Matter Expert to design challenging evaluation questions that assess advanced AI models. You will develop coding... ...in bioinformatics domains. This remote position requires a Master’s degree or...Remote workContract work
- YO AI Labs is seeking Medical Evaluation Specialists, including medical students, residents, physicians, and qualified biomedical professionals, to contribute clinical expertise to evaluating and improving next-generation AI systems. You will create and validate challenging...Remote jobMedical
- ...Description In this AI/ML ASIC Architecture position... .... As an AI/ML ASIC Architect you will help drive new... .../Emulation/FW teams to evaluate these changes and... ...childbirth or related medical conditions, breastfeeding... ...Colorado, New York or remote jobs that can be performed...Remote workMedicalTemporary workFlexible hoursShift workNight shift
- ...strategically and responsibly use AI, automation and... ...the AI Transformation Architect is a hands-on builder... ...workflow orchestration, evaluations, agent instructions,... ...including:• Immediate medical, dental, vision and prescription... ...a Ford hub location or remote for non-local...Remote workMedicalWork at officeLocal areaImmediate startFlexible hours
$50 per hour
...Role Overview Evaluate, benchmark, and help improve the coding capabilities of advanced AI models by assessing AI-generated solutions... ...type, contractor assignment, no medical or paid leave provided.... ...next week. Work location, remote, candidates must be located in...Remote workMedicalContract workFor contractors- Role Description As an AI Architect, you’ll report to the Head AI Architect and... ...systems, creative generators, evaluation/judging panels, and guardrail checks... ...plates. Benefits ~Fully remote within the US ~100% employer-paid medical, dental and disability, with...Remote workMedicalFull timeWork at officeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Medical Evaluation Architect for AI Benchmarks. Be the first to apply!
- software engineering manager remote Dallas, TX
- system engineer remote Dallas, TX
- remote technical project manager Dallas, TX
- remote recruitment consultant Dallas, TX
- remote property manager Dallas, TX
- remote reviewer Dallas, TX
- remote insurance agent Dallas, TX
- remote no experience Dallas, TX
- remote life underwriter Dallas, TX
- remote medical coding supervisor Dallas, TX



