Remote AI Evaluations Engineer for Healthcare Systems
$150k - $180kEllipsis Health
San Francisco, CA
- Remote job
A health technology company is seeking a skilled infrastructure engineer to build and maintain AI evaluation tooling. The ideal candidate has over 5 years of experience in software engineering with a focus on backend systems and production-grade infrastructure. This role offers a competitive salary range of $150,000 to $180,000, along with flexible benefits including health insurance and 401(k) matching. #J-18808-Ljbffr Ellipsis Health
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Remote AI Evaluations Engineer for Healthcare Systems in San Francisco, CA vacancy
$150k - $180k
...AI Evaluations Engineer – HealthcareLocation: Remote, located in the USType: Full-timeDepartment: EngineeringReports to... ...evaluation frameworks for individual system components such as ASR, LLMs, TTS... ...services)Experience working in healthcare or other regulated environments,...Remote workFlexible hoursEllipsis Health
San Francisco, CA2 days ago$180k - $250k
...Senior AI Engineer — Voice & Agentic Systems Location: Remote (US) / Hybrid (Boston or San Francisco) Company Stage... ...client is building personalized AI healthcare infrastructure for Medicare... ...learning feedback loops Design evaluation infrastructure for agent...Remote workH1bWork at officeRecruiting from Scratch
Boston, MA2 days ago- ...A leading healthcare solutions provider seeks an AI Engineer III to drive innovation by developing AI/ML applications.... ...collaboration to turn concepts into robust systems. Candidates should have at least 3... .... This position is fully remote and offers competitive compensation...Remote work
Premera Blue Cross
New York, NY4 hours ago - A health tech organization is searching for a Principal AI Engineer to design and build advanced AI systems for healthcare delivery. The role emphasizes developing systems that coordinate patient care and improve health outcomes through a data-driven approach. Candidates...Remote workWork from homeFlexible hours
Pair Team
San Francisco, CA2 days ago - A leading healthcare technology firm is seeking a Senior AI/ML Engineer to revolutionize healthcare through advanced machine learning... ...and implement innovative AI systems to improve healthcare outcomes.... .... The position allows for remote work flexibility, catering specifically...Remote work
Optum
Eden Prairie, MN2 days ago $170k - $200k
A healthcare-focused technology company in San Francisco seeks a Senior AI Engineer to design and build AI systems that enhance care delivery. You will create solutions that engage patients and streamline care workflows, ensuring reliable, production-grade results. Ideal...Remote workFlexible hoursPair Team
San Francisco, CA2 days ago$180k - $220k
...A healthcare technology company is seeking an experienced AI systems engineer to design and operate production AI workflows. The successful candidate will have 8+ years... ...record of deploying production AI products. This remote role offers a competitive salary between $180,...Remote workFlexible hoursAtlas Health
New York, NY4 hours ago- A leading healthcare organization is seeking a proactive AI developer to create and implement AI-based tools and workflows... ...cross-functional teams to enhance system performance and ensure ethical AI... ...and OpenAI API. Offering remote flexibility and a competitive salary...Remote work
UnitedHealth Group
Irvine, CA10 days ago - ...beneficiaries with a dedicated healthcare advocate who navigates... ...caring nurses while AI agents handle the... ...the healthcare system on your behalf, and propels... ...'re looking for an AI engineer to own the loop that turns... ...pipeline. Set up the evaluation infrastructure that...Full time
Mira Mace
San Francisco, CA4 hours ago $60 per hour
A leading AI development company is seeking proficient programmers to contribute to cutting-edge AI systems. Join a fully remote team and enjoy the flexibility of selecting projects and setting... ...high-quality code snippets, and evaluating AI-generated code. Ideal candidates...Remote workDataAnnotation
Santa Fe, NM3 days ago- ...A leading AI development company is seeking proficient programmers to contribute to developing cutting-edge AI systems. Enjoy fully remote work with the flexibility to choose your own schedule... ...training, writing clear code, and evaluating AI-generated solutions. Ideal...Remote work
DataAnnotation
New York, NY2 days ago - ...AI Engineer Job Description About PulsePoint: PulsePoint is a fast-... ...real-time data to transform healthcare. We help brands and agencies... ...interfaces. Experiment and evaluate new frameworks, models, and... ...foundation of generative AI systems in PulsePoint. Core Engineering...Remote workFlexible hours
PulsePoint
New York, NY4 hours ago - ...building an agentic AI caregiver advocate... ...time. The AI engineering challenge: build an... ...design agentic systems that reason, plan,... ...use frameworks, and evaluation infrastructure that... ...integrations with healthcare systems. Each tool... ...Flexible remote-first work environment...Remote workImmediate startFlexible hours
Citizen Health
United States5 days ago - ...financial services to healthcare, automotive,... ...Modelling. This is a remote position. ~ You will... ...scalable, production-grade AI systems that automate and enhance... ...~ You will develop evaluation and guardrail... ...partner with analytics, engineering, and product teams to...Remote workWork at officeLocal areaFlexible hours
Experian
Costa Mesa, CA1 day ago - ...Senior AI Engineer, Forward Deployed At Komodo Health... ...That's why we built the Healthcare Map — the industry's... ...of the U.S. healthcare system — by combining de-... ...Experience with LLM evaluation frameworks in production... ...term partnerships. #LI-Remote The pay range for each...Remote workWork experience placementLocal areaFlexible hours
Komodo Health
San Francisco, CA1 day ago - ...Senior AI Engineer - LLM & Agentic Systems (Python) Remote Role Overview We are seeking a senior AI engineer to design and build production... ...backend services, and cloud platforms Establish evaluation, reliability, and performance strategies (accuracy...Remote work
RIT Solutions, Inc.
Atlanta, GA4 hours ago - ...is seeking experienced professionals to evaluate AI-generated security content and solve complex... ...problems. This role is fully remote, allowing candidates to choose projects... ...providing valuable feedback to enhance AI systems. Strong analytical and writing skills are...Remote work
DataAnnotation
Lincoln, NE2 days ago - ...Senior AI Software Engineer – Alpha Lab Empower LTC Pharmacies... ...Build the Future of Healthcare Technology. About... ...measurable outcomes Evaluate AI feature readiness... ...the healthcare system. Modern Work Environment... ...flexible hours Remote‑Work Bank for additional...Remote workWork at officeVisa sponsorshipWork visaFlexible hours
SoftWriters Inc
Pittsburgh, PA4 days ago $40 per hour
A leading technology firm is seeking experienced cybersecurity professionals to evaluate AI-generated security content and provide feedback for improving AI systems. This remote position offers flexibility in project selection, with an hourly pay starting at $40+. Candidates...Remote workHourly payDataAnnotation
Washington DC2 days ago$40 per hour
A leading AI cybersecurity firm seeks experienced cybersecurity... ...professionals to help train AI models remotely. Candidates must have over 2... ...experience in cybersecurity, evaluate AI-generated content, and provide feedback to improve AI systems. The role offers flexibility...Remote workHourly payDataAnnotation
Annapolis, MD3 days ago$40 per hour
...join our team to help train AI models. In this role, you will evaluate AI-generated security... ...feedback to improve how AI systems reason about real-world... ...a full-time or part-time REMOTE position You’ll be able to... ...incident response, detection engineering, DFIR, malware analysis,...Remote workHourly payFull timePart timeDataAnnotation
New York, NY2 days ago- ...building tools that help healthcare teams work faster... ..., and believe AI should amplify... ...the orchestration systems that coordinate LLM... ...history, and the evaluation frameworks that keep... ...Vertex AI Matching Engine. You understand... ...company—we get it) Remote‑first, async‑friendly...Remote work
Basalt
New York, NY4 hours ago - ...cybersecurity technology company is seeking experienced professionals to evaluate AI-generated content and solve technical cybersecurity problems. You'll work remotely to provide feedback for improving AI systems that address real-world threats, with hourly pay starting at $40....Remote workHourly pay
DataAnnotation
Boston, MA3 days ago $160k - $200k
...Principal AI Engineer Mansfield, MA (Remote) eClinical Solutions is transforming... ...makes a real-world impact on healthcare, this is the place to do... ...orchestration logic, and evaluation harnesses Apply... ...and error analysis of AI systems Drive the entire workflow...Remote workeClinical Solutions
United States2 days ago- ...is seeking experienced professionals to evaluate AI-generated security content. The responsibilities... ..., and providing feedback to improve AI systems. Candidates should have over 2 years of... ...some coding skills. This position is remote and allows for flexible hours, making it...Remote workFlexible hours
DataAnnotation
Providence, RI2 days ago $40 per hour
...cybersecurity firm is seeking experienced professionals for a remote role evaluating AI-generated security content. Candidates will work on solving technical problems, providing feedback to enhance AI systems in cybersecurity. Ideal candidates have over 2 years of hands...Remote workHourly payFlexible hoursDataAnnotation
Nashville, TN2 days ago- ...building real-world AI systems for public health impact... ...role oversees evaluation, safety, and responsible... ...governance for LLM-powered healthcare chatbot systems.... ...6 hours per week ~ Remote ~ Flexible schedule... ...evaluation, RAG, and prompt engineering Understanding of...Remote workFlexible hours
Health4TheWorld
Palo Alto, CA3 days ago $152k - $222.6k
...country, serving clients across healthcare, life sciences, education, gaming... ...here. Role Summary Join Suffolk’s AI Studio in Boston as an AI Systems Engineer, a hybrid role responsible for... ...performance, and reliability. Implement evaluation frameworks to measure model...Temporary workFor contractorsWork at office- ...Ascertain is building AI agents to automate... ...in major health systems and large... ...Management, a leading healthcare investment firm.... ...first dedicated AI engineers focused on agentic... ...Ascertain builds, evaluates, and operates agents... ...model: This role is remote-friendly. For NYC-...Remote workWork at officeFlexible hours
Ascertain
United States3 days ago $214k - $300k
Monograph is seeking an engineer to build and improve AI evaluation systems aimed at increasing shipping quality for AI tools. You will enhance scalable eval runners, improve benchmarks, and ensure reliability in distributed systems. Strong engineering fundamentals and...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Evaluations Engineer for Healthcare Systems. Be the first to apply!
Related searches
- machine learning ai engineer San Francisco, CA
- senior ai engineer San Francisco, CA
- ai engineer remote San Francisco, CA
- ai ml engineer San Francisco, CA
- ai engineer San Francisco, CA
- ai developer San Francisco, CA
- ai research engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- operations support system engineer San Francisco, CA
- microsoft systems engineer San Francisco, CA