Staff Software Engineer (AI)

The Role We're seeking an experienced and highly capable AI engineer who is motivated to meaningfully improve the way healthcare is administered in the United States. You'll take ownership of developing a significant part of the Onos platform, including the development of models for assessing the level of appropriate care for patients. As an early team member, you'll be expected to wear multiple hats, including acting as a backend/data engineer, while ensuring excellent outcomes for our customers. This role is a hybrid role based in San Francisco, where you'll be expected to work at our office in person 2-3 times a week. What You'll Be Doing At Onos Develop LLM/NLU systems to process and extract meaningful information from clinical notes and medical documents, classify patients according to level-of-care guidelines, and make accurate recommendations Establish best practices for LLM/AI systems, benchmarking/evaluation frameworks, and model governance to improve reliability, maintainability, and scalability Build data pipelines that scale efficiently while maintaining strict data privacy and security standards Collaborate with backend engineers to integrate AI/ML capabilities seamlessly into the Onos platform Technical Challenges At Onos Build and operationalize AI/data pipelines to analyze medical records to streamline clinical assessments and healthcare quality reviews Benchmark LLM systems to more accurately and reliably extract evidence from medical records and classify patients' level-of-care recommendations Develop and optimize a system that ingests complex medical standards of care documents and evaluates provider adherence to guidelines Design explainable AI solutions that provide transparency into model decisions for healthcare professionals Tech Stack: Infrastructure/Systems: AWS (ECS, Bedrock, Cognito, etc.), Docker, Github Actions Languages/Frameworks: Python, Django, Celery, django-ninja, django-tenants Database/Storage: PostgreSQL (AWS RDS), S3 Development Tools: Github, Jira, CoderabbitAI, Tusk, Claude What We're Looking For 5+ years experience building and deploying applications in production in a backend engineering / data engineering capacity Relevant experience with developing LLM-based systems for ingesting and evaluating unstructured records for industry-specific use cases and integrating them with user-facing features Deep understanding of the limitations of using LLMs and the best practices for using them for reliable, consistent, and accurate outputs Customer obsessed and motivated to build a best-in-class model for behavioral health clinical assessments in the healthcare space A collaborative team player with a focus on delivering measurable results Bonus Points If You Have Specifically worked with medical records to evaluate whether a patient's history meets criteria for evaluations or assessments (e.g., claims authorization or other types of evaluations) Experience wearing multiple hats as a generalist backend engineer Experience working with data pipelines and Python and related data science/ML libraries Significant experience working with healthcare data and with HIPAA best practices Knowledge of modern LLM and ML infrastructure and MLOps best practices Benefits And Perks Flexible hybrid arrangement: 2-3 days/week at San Francisco office (Financial District), remote-first culture Unlimited vacation policy Paid parental leave Medical, dental, and vision insurance Pre-tax commuter benefits 401(k) Significant equity as an early employee Direct mentorship from experienced founders Ground-floor opportunity to help build a team and culture Regular team events and offsites Company-provided equipment and home office setup We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. Onos Health