Remote AI Evaluations Engineer for Healthcare Systems
$150k - $180kEllipsis Health
A health technology company is seeking a skilled infrastructure engineer to build and maintain AI evaluation tooling. The ideal candidate has over 5 years of experience in software engineering with a focus on backend systems and production-grade infrastructure. This role offers a competitive salary range of $150,000 to $180,000, along with flexible benefits including health insurance and 401(k) matching. #J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote AI Evaluations Engineer for Healthcare Systems in San Francisco, CA vacancy
$150k - $180k
...AI Evaluations Engineer – HealthcareLocation: Remote, located in the USType: Full-timeDepartment: EngineeringReports to... ...evaluation frameworks for individual system components such as ASR, LLMs, TTS... ...services)Experience working in healthcare or other regulated environments,...Remote workFlexible hoursEllipsis Health
San Francisco, CA1 day ago$180k - $250k
...Senior AI Engineer — Voice & Agentic Systems Location: Remote (US) / Hybrid (Boston or San Francisco) Company Stage... ...client is building personalized AI healthcare infrastructure for Medicare... ...learning feedback loops Design evaluation infrastructure for agent...Remote workH1bWork at officeRecruiting from Scratch
Boston, MA1 day ago- ...mission-critical building systems, energy efficiency,... ...as data centers, healthcare, pharmaceuticals, advanced... ...team is seeking an AI Systems Engineer - Data Centers - for... .... This position is remote based. How you will... ...and facility scale. Evaluate system resiliency and...Remote work
Johnson Controls
New Freedom, PA3 days ago - ...mission is simple: make healthcare data usable, so the... ...the thoughtful use of AI and automation to drive... ...of agentic, LLM-driven systems scales, ensuring these... ...AI Systems Quality Engineer plays a critical role... ...embedding guardrails, evaluation signals, and safe-failure...Remote workLocal areaHome office
Abacus Insights
United States3 days ago - A health tech organization is searching for a Principal AI Engineer to design and build advanced AI systems for healthcare delivery. The role emphasizes developing systems that coordinate patient care and improve health outcomes through a data-driven approach. Candidates...Remote workWork from homeFlexible hours
Pair Team
San Francisco, CA1 day ago $180k - $220k
...A healthcare technology company is seeking an experienced AI systems engineer to design and operate production AI workflows. The successful candidate will have 8+ years... ...record of deploying production AI products. This remote role offers a competitive salary between $180,...Remote workFlexible hoursAtlas Health
New York, NY4 days ago$170k - $200k
A healthcare-focused technology company in San Francisco seeks a Senior AI Engineer to design and build AI systems that enhance care delivery. You will create solutions that engage patients and streamline care workflows, ensuring reliable, production-grade results. Ideal...Remote workFlexible hoursPair Team
San Francisco, CA11 days ago$170k - $220k
...and scalable data and AI solutions, while strengthening... ...HealthVerity’s engineering framework through real... ...and production-ready systems. You will help turn fragmented... ...environments (e.g., healthcare, life sciences,... ...team members working remotely. While these employees...Remote workPermanent employmentFull timeWork at officeLocal areaWork from homeFlexible hours3 days per weekDormont Manufacturing Company
New York, NY20 hours ago$210k - $235k
A healthcare technology company in California seeks a Staff AI Engineer to design and build AI systems enhancing complex care processes. The role involves collaborating with product teams, leading the development of agent-based systems, and ensuring operational reliability...Remote workPair Team
San Francisco, CA1 day ago- ...building real-world AI systems for public health impact... ...role oversees evaluation, safety, and responsible... ...governance for LLM-powered healthcare chatbot systems.... ...6 hours per week ~ Remote ~ Flexible schedule... ...evaluation, RAG, and prompt engineering Understanding of...Remote workFlexible hours
Health4TheWorld
Palo Alto, CA2 days ago $170k - $200k
...Team is building a new kind of healthcare system across Medicaid, Medicare,... ...benefit corporation and AI-enabled medical group, we partner... ...Role As a Senior AI Engineer, you will help design and build... ...through observability, evaluation, and continuous improvement...Remote workTemporary workLocal areaWork from homeFlexible hoursPair Team
United States3 days ago- ...A pioneering AI technology firm based in San Francisco is seeking an AI Engineer to own the evaluation infrastructure for AI agents. This role requires designing automated pipelines and building observability systems, ensuring agent performance meets enterprise standards...Remote workFlexible hours
Fieldguide.ai
San Francisco, CA21 hours ago - ...looking for experienced software engineers to contribute their expertise to AI evaluation and improvement projects. This role... ...engineering skills to assess AI systems with no prior AI experience... ...research teams. The position is fully remote, project-based, with competitive...Remote workFreelance
Feedinkoo
New York, NY1 day ago $30 - $50 per hour
...A leading tech company is seeking an AI Engineer for a remote role. You will build, evaluate, and deploy production AI systems, focusing on NLP, LLMs, and computer vision. The ideal candidate will have mid-senior experience in delivering ML systems, strong Python skills...Remote workHourly payRex USA
New York, NY3 days ago$152k - $222.6k
...AI Systems Engineer ID 2026-10479 Job Location : Location US-MA-Boston Type... ...in the country, serving clients across healthcare, life sciences, education, gaming, aviation... ..., and reliability Implement evaluation frameworks to measure model performance...Full timeTemporary workFor contractorsWork at officeSuffolk Construction
Boston, MA2 days ago- ...Forward Deployed AI Engineers (FDEs) We are hiring Forward Deployed... ...with one of the largest healthcare payers in the U.S. to drive... ...workflows Implement multi-agent systems using LLMs (prompting,... ...pipelines Knowledge of model evaluation, monitoring, and governance...Remote work
The Giant Bullseye
United States5 days ago $142.65k - $213.98k
...from the office for the remote option.) Job Summary The Agent Evaluation team is responsible for testing whether AI agents return the correct... ...human-in-the-loop evaluation systems to assess agent... ...quality Partner with engineering, and product teams to deliver...Remote workWork experience placementWork at officeWorldwideComcast Corporation
Washington DC4 days ago- ...beneficiaries with a dedicated healthcare advocate who navigates... ...caring nurses while AI agents handle the... ...the healthcare system on your behalf, and propels... ...'re looking for an AI engineer to own the loop that turns... ...pipeline. Set up the evaluation infrastructure that...Full time
Mira Mace
San Francisco, CA4 days ago $150k - $250k
...Senior AI Engineer, Agentic Evaluation & V&V Remote At Slingshot Aerospace, we're on a mission to make space safer and more secure for everyone. Our... ...organization. You will contribute to advancing how intelligent systems are evaluated and validated for mission-critical...Remote workFull timeCurrently hiringSlingshot Aerospace
United States3 days ago- ...Senior AI Engineer Bogota, Colombia (Remote Friendly) Robots & Pencils is an applied... ...Energy, Financial Services, Healthcare, and Manufacturing and... ...alternative to traditional global systems integrators. Founded in 2... ...~ Experience with evaluation frameworks, and...Remote workWorldwide
Robots & Pencils
United States2 days ago - ...Our partner is looking for a Senior AI Engineer, Agentic Systems based in United States. This is a... ...tool registries, and policy guards Evaluate and apply agentic frameworks such as... ...incentives, and equity participation Remote-first flexibility with US-based...Remote jobFull timeFlexible hours
jobgether
United States1 day ago - ...Senior AI Engineer Sift Healthcare is seeking an AI Engineer to join our highly collaborative, growing... ...accelerate cash flow. Large health systems, leading HCIT vendors, payers and... ...automation. Implement systematic LLM evaluation and monitoring, including task-level...Remote work
Sift Healthcare
United States3 days ago - ...AI Engineer Job Description About PulsePoint: PulsePoint is a fast-... ...real-time data to transform healthcare. We help brands and agencies... ...interfaces. Experiment and evaluate new frameworks, models, and... ...foundation of generative AI systems in PulsePoint. Core Engineering...Remote workFlexible hours
PulsePoint
New York, NY4 days ago $115k - $231k
...AI Engineer The AI Engineer plays a critical hands-on role in bringing... ...into structured prompts, system instructions, agent... ...the AI Solutions Architect to evaluate and implement new AI tools and... ...operational excellence across healthcare technology. Verathon is an equal...Remote workFull timeVerathon
United States1 day ago- ...Ascend Learning, a leading healthcare and learning... ...locations and hybrid and remote workers in cities across... ...YOU'LL DO As an AI Engineer, you will be instrumental... ...deploy distributed systems and backend services that... ...Research and evaluate new tools and techniques...Remote workFor contractorsWork experience placementWork at officeFlexible hours
Ascend Learning
Leawood, KS1 day ago - ...Senior AI Engineer - LLM & Agentic Systems (Python) Remote Role Overview We are seeking a senior AI engineer to design and build production... ...backend services, and cloud platforms Establish evaluation, reliability, and performance strategies (accuracy...Remote work
RIT Solutions, Inc.
Atlanta, GA4 days ago - ...building an agentic AI caregiver advocate... ...time. The AI engineering challenge: build an... ...design agentic systems that reason, plan,... ...use frameworks, and evaluation infrastructure that... ...integrations with healthcare systems. Each tool... ...Flexible remote-first work environment...Remote workImmediate startFlexible hours
Citizen Health
United States4 days ago - ...financial services to healthcare, automotive,... ...Modelling. This is a remote position. ~ You will... ...scalable, production-grade AI systems that automate and enhance... ...~ You will develop evaluation and guardrail... ...partner with analytics, engineering, and product teams to...Remote workWork at officeLocal areaFlexible hours
Experian
Costa Mesa, CA1 day ago - ...Job Description: The Sr. Staff Engineer, AI will lead the architecture,... ...continuous improvement of agentic AI systems across multiple healthcare domains. This role will own complex... ...Drive model selection, fine-tuning, evaluation design, red-teaming, and continuous...Remote workContract work
NextGen Healthcare
United States5 days ago $50 - $175 per hour
A leading AI solutions firm is seeking an AI Safety and Evaluations Engineer for a 12-month contract, focusing on designing evaluation... ...specific metrics in RAG-based systems. With a requirement of 3+ years... ...safety of AI models. This is a remote opportunity with a pay range of...Remote workContract workDeWinter Group
Campbell, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Evaluations Engineer for Healthcare Systems. Be the first to apply!
Related searches
- senior ai engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- ai engineer remote San Francisco, CA
- ai engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- ai developer San Francisco, CA
- ai research engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- healthcare systems engineer San Francisco, CA
- application system engineer San Francisco, CA