Remote Medical Evaluation Architect for AI Testing
YO AI Labs
- Remote job
YO AI Labs is seeking Medical Evaluation Specialists to craft and validate challenging medical questions and answers for AI evaluation. Remote contractor role focusing on clinical expertise, literature review, and rigorous reasoning. You will develop high-difficulty items spanning diagnosis, pathophysiology, pharmacology, and guidelines, ensuring accuracy and defensible explanations for AI benchmarks. #J-18808-Ljbffr YO AI Labs
$215k - $300k
...seeking a Principal Architect to help lead the next generation of AI-enabled product,... ...AI orchestration, evaluations, AI observability,... ...capabilities across coding, testing, documentation,... ....Location:Remote -Chicago, ILIf this... ...contributionsComprehensive Medical, Dental & Vision...Remote workMedicalFull timeLocal area- YO AI Labs seeks Medical Evaluation Specialists, including medical students, residents, physicians, and biomedical... ...medical questions and answers to test advanced clinical reasoning,... ...rationales with citations. This is a remote contractor role emphasizing high-quality...Remote jobMedicalFor contractors
$80 per hour
A leading AI consultancy is seeking a detail-oriented individual to design evaluation scenarios for LLM-based agents. This part-time, remote role allows you to create structured test cases while working flexibly around your commitments. The ideal candidate holds a relevant...Remote workPart time$191.2k - $239k
...are looking for an Architect who will own the... ...DigitalOcean operates as an AI-native business —... .... Quality held to evaluation evidence as models... ..., regression testing, observability for... ...39,000 This is a remote role Why You’ll... ...age, disability, medical condition, pregnancy...Remote workMedicalLocal areaWorldwideFlexible hours- ...countries.Job DescriptionAs the AI Native Principal Architect, you will help define the... ...is preferred; however, remote candidates will also be considered... ...development, productivity testing, and operational efficiency... ....Core benefits including medical, dental, vision, and...Remote workMedicalWork at officeLocal areaFlexible hours
$128k - $192k
...experience as an Architect. • 3+ years of experience... ..., and framework evaluation • Hands on... ...practices such as unit testing, static analysis... ...expectations for responsible AI tool usage across... ...the following: • Medical, Dental, and... ...is a fully remote position.Application...Remote workMedicalPermanent employmentFull timeTemporary workWork experience placement$156k - $234k
...requires: The Practice Architect - AWS Migrations &... ...and agentic AI responsibly to accelerate... ..., remediation, testing, refactoring, and... ...artifacts; and evaluate emerging AWS and AI... ...the following: • Medical, Dental, and Vision... ...TypeThis is a fully remote position....Remote workMedicalPermanent employmentFull timeTemporary workRelocation$160k - $225k
...Engineering Lead Architect is a senior technical... .... • Review test strategies, results... ...simulation modeling and AI-driven performance... ...the following: • Medical, Dental, and... ...TypeThis is a fully remote position.Application... ...sourcing, screening, and evaluating candidates. AI...Remote workMedicalPermanent employmentFull timeTemporary work$160k - $225k
DescriptionThe Lead Architect is a hands on... ...patterns. Continuously evaluate and adopt new... ...REST), automated testing, CI/CD pipelines,... ...Applications Developer.AI Skills & Tool Usage... ...the following: • Medical, Dental, and Vision... ...is a fully remote position.Application...Remote workMedicalPermanent employmentFull timeTemporary workWork experience placement$116.16k - $154.88k
...development practices, including AI-assisted software... ...and maintain automated test frameworks Leverage AI... ...working with fully remote teams Experience with... ...Demonstrated ability to evaluate and integrate AI tools... ...including healthcare benefits (medical, dental, and vision),...Remote workMedicalSummer workLocal areaHome office$246.5k
...contributor responsible for architecting, designing, and... ...champion innovation and AI-assisted engineering practices... ...quality, and automated testing Contribute to a... ...generally flexible for remote work, except for... ...may include healthcare (medical, dental, and vision), life...Remote workMedicalFull timeWork at officeLocal areaMonday to ThursdayFlexible hours- YO AI Labs seeks Medical Evaluation Specialists (medical students, residents, physicians, and biomedical professionals) to create and validate high-difficulty medical questions and answers for testing AI systems. You will craft items that challenge clinical reasoning and...Remote jobMedical
- ...AI Evaluation Engineer Location: USA Remote Employment Type: Contract Position Summary We are... ...engineering teams. Build regression testing approaches for LLM applications,... .... Experience designing medical-accuracy or domain-specific evaluation...Remote workMedicalContract work
$144.7k - $221.4k
...Organization The Evaluation team builds and evolves... ...own large-scale test scenario libraries... ...Responsibilities) Architect and implement... ...Experience leveraging AI-assisted... ...evaluation coverage.Hybrid/Remote: This role can be... ...Benefit options include medical, dental, vision,...Remote workMedicalFull timeLocal areaWork from homeRelocationRelocation packageFlexible hours- ...in the convergence of AI, automation, agents, people... ....As a Principal AI Architect - Healthcare, you will... ...transformation strategies, evaluate technology investments,... ...networks, academic medical centers, or other complex... ...hybrid, office-based, and remote workers will vary from...Remote workMedicalWork at officeImmediate start
$110.6k - $178k
Product Architect - AI & Digital ProductsCome make the world and accelerate... ...Product team working as a remote employee. We're building a... ...ideas and technical feasibility.Evaluate commercial platforms, open-... ...benefits plan, including:Medical, dental, life, vision, disability...Remote workMedicalFull timeLocal area$134.9k - $237.3k
...the one building AI-powered experiences... ...Overview: The AI Architect, Presales will... ...requirements Establish AI evaluation and observability... ...and online testing, retrieval quality... ...#Li-CP1 #LI-Remote Compensation:... ....00 Benefits: ~ Medical, Dental, and Vision...Remote workFull timeWork from homeWorldwideFlexible hours$136k - $204k
...requires:The Practice Architect, Level 1 is a... ...production-ready AI solutions. You will... ...the following: • Medical, Dental, and Vision... ...TypeThis is a fully remote position.... ...administer a lie detector test as a condition of... ...sourcing, screening, and evaluating candidates. AI...Remote workMedicalPermanent employmentFull timeTemporary work$136k - $204k
Practice Architect AI/ML ( Full-time, Remote) Think of TEKsystems Global Services (TGS)... ...include the following: • Medical, Dental, and Vision • Critical... ...administer a lie detector test as a condition of... ...sourcing, screening, and evaluating candidates. AI helps assess...Remote workMedicalPermanent employmentFull timeTemporary work$150k - $180k
...the forefront of applied AI, helping enterprises... ...operations as Forward Deployed Architects (FDA) and Forward... ...works. ~ You evaluate. You have built or owned... ...KPI, “it looked good in testing” is not an answer. Define... ...not just use them ~ Remote-friendly culture ~...Remote workFull timeContract workWork at officeWorldwide$100 - $130 per hour
...first 25 applicants Get AI-powered advice on this... ...features. Position: APPIAN ARCHITECT / Appian Lead Developer... ...Plano TX / Maryland ( Remote). Work type: Fulltime(... ...should develop and test user management business... ...Multiple Locations) Senior Medical Planner/ Healthcare...Remote workMedicalFull timeWork experience placementCurrently hiring$142.8k - $274.8k
...MicrosoftOverviewWe are looking for a Principal AI Architect to help define, build, and scale the evaluation systems that shape the future of... ...to evaluate with traditional testing alone. The person in this role... ..., citizenship, color, family or medical care leave, gender identity or...MedicalOngoing contractLocal area3 days per week$213k - $240k
...locations globally. The RoleThe AI Architect is a member of a highly... ...lifecycle, from experimentation and evaluation to deployment and... ...Prototype, evaluate approaches, test feasibility, and productionize... ...childbirth, breastfeeding or related medical conditions), national origin,...MedicalPermanent employmentFull timeWork at officeLocal area$105.78k - $189.35k
...here!PURPOSE OF THE JOBThe AI Architect II is a senior technical leadership... ...AI gateway design.Lead the evaluation, selection, and integration... ...CI/CD pipelines, automated testing, container orchestration (... ...package, with generous medical, dental, and vision plans as...MedicalFull timeWork at officeLocal area- ...organization seeks a Principal Architect to lead our AI Strategy and Emerging... ...research, investigate, track, and evaluate innovative AI capabilities.... ...red-teaming, adversarial testing, and monitoring to mitigate... .... We offer a choice of medical, dental and vision plans in...MedicalFull timeLocal areaImmediate start
- ...are looking for a Cloud Architect with deep AWS and Red... ...Kubernetes expertise to make testing and verification a core... ..., and agentic AI capabilities to advance... .... This individual will evaluate and adopt the right tools... ...health benefits including medical, dental, vision, short/...MedicalContract workTemporary workLocal areaShift work
$147.9k - $254.8k
...AI & Cloud Architect Founded in 1977 as the Senior Care Action Network, SCAN began with a simple... ..., primary care, care for the most medically and socially complex populations, and... ...cloud environments for model training, evaluation, and inference. Oversee vector database...Remote workMedical$118.4k - $186.85k
...lifecycle. You research and evaluate the full landscape of... ...closely with peer architects to ensure coherent,... ...developing, deploying, and testing high performance multi... ...not limited to: * Medical, Dental, and Vision... ...Work Arrangements (Remote & Alternate Work Schedules...Remote workMedicalFull timePart timeFlexible hours- ...Senior Architect Charlotte, North Carolina;Jersey... ...strategic objectives, evaluating the impact of strategic... ...designs. Also provide DMZ/Remote Access/SDWAN/Hosting/B... ...Experience test tools including Quali... ...on other bases such as medical condition, marital status...Remote workMedicalWork at officeFlexible hoursShift workDay shift
$275.84k - $344.8k
...Our dedication to remote-first work , and strong... ...Artificial Intelligence (AI) to help make our hiring... ...as Twilio’s next Sr AI Architect - Conversation AI. About... ...capabilities. Evaluate and implement modern LLM... ...decisions, or related medical conditions), sexual orientation...Remote workMedicalLocal areaWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Medical Evaluation Architect for AI Testing. Be the first to apply!
- system engineer remote Palo Alto, CA
- remote recruitment consultant Palo Alto, CA
- remote no experience Palo Alto, CA
- informatica remote Palo Alto, CA
- remote lawyer Palo Alto, CA
- marketing remote Palo Alto, CA
- data science internship remote Palo Alto, CA
- customer service representative remote Palo Alto, CA
- remote customer service manager Palo Alto, CA
- remote medical coder (no experience in coding) Palo Alto, CA


