Senior AI Engineer

Role Description

As a Senior AI Engineer at Atria, you will own the design, development, and production deployment of the LLM-powered systems that put AI directly in front of clinicians and members:

• Agentic medical companions
• Clinical decision support
• Document understanding pipelines that turn unstructured clinical data into usable signal

This is a hands-on, high-ownership role for an engineer who wants to do work with direct patient impact.

What you'll do

• Architect and ship production AI systems end-to-end (orchestration, retrieval, inference, evaluation, and monitoring) for clinical decision support, document understanding, and agentic medical companions.
• Design agentic workflows with custom skills and harnesses, using frontier LLMs and self-hosted models where appropriate.
• Lead development of structured information extraction pipelines from clinical documents, including automated verification systems and human-in-the-loop gates, where necessary.
• Build robust evaluation infrastructure (golden datasets, LLM-as-judge, regression tests, online A/B evaluation) that gates every model and prompt change.
• Engineer for latency and cost: streaming, caching, prompt compression, model routing, and inference-cost budgets.
• Own production health: trace- and span-level observability, prompt versioning, drift detection, cost monitoring, replay-from-production for debugging, PHI-safe logging throughout.
• Operationalize models trained by the AI Scientist team: serving, evaluation in production, rollback paths, and feedback loops that turn real usage into training and eval data.
• Partner with clinicians, the data engineering team, and research collaborators to translate clinical requirements into specifications and deliverable systems.
• Educate and mentor PMs and engineers across Atria on applied AI best practices.

Leadership and Influence

• Set technical direction for AI engineering at Atria: architecture decisions, build-vs-buy calls, and evaluation and observability standards.
• Raise the bar on engineering practices, code review, observability, and incident response.
• Drive vendor and partner technical due diligence for AI/ML vendors: BAA scope, PHI handling, sub-processor obligations, and IP terms.
• Mentor other AI engineers through code review, design docs, and architecture decisions.
• A bias to ship: prefer a rough thing in production tomorrow over a beautiful thing in a design doc next quarter.
• A scrappy streak: pick up an unfamiliar tool, framework, or clinical concept quickly.
• A serious drive to keep getting better: read others' code, papers, and post-mortems.

Qualifications

• Hands-on experience building and operating LLM-powered or production ML systems: 4+ years.
• Strong Python skills and deep familiarity with at least one production backend framework (FastAPI, Flask, etc.).
• Hands-on experience with LLM orchestration, function/tool calling, and retrieval system design.
• Working knowledge of a cloud data warehouse (Snowflake strongly preferred) and modern data tooling such as dbt, Dagster, or Airflow.
• A track record of designing evaluation systems for LLM applications.
• Familiarity with safety considerations for LLM applications.
• Practical understanding of HIPAA, BAAs, PHI handling, and working in a regulated environment.
• Strong written communication: design docs, technical RFCs, and documentation.

Nice to have

• Experience in healthcare, clinical informatics, or other regulated domains.
• Familiarity with medical ontologies (LOINC, SNOMED CT, ICD-10, RxNorm) and clinical data standards (FHIR, HL7).
• Experience with self-hosted model serving and inference optimization.
• Multimodal experience: vision, structured data, or time-series data alongside text.

Salary and Benefits

• Salary range: $190,000 - $250,000 + performance-based bonus
• Excellent health and wellness benefits, fully covered by Atria, effective date of hire
• OneMedical membership for employees & dependents, giving access to 24/7 virtual care
• Fertility & family planning
• Company-covered preventive health screenings through partner hospitals
• Fitness Perks, including Wellhub +
• 401k contributions and 4% match starting after 6 months
• Flexible Time Off
• Continuing medical education (CME) and CEU support for professional licensure