Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, Evals and AI Infra

Commure

Join Commure in Revolutionizing Healthcare Technology

At Commure, our mission is to simplify healthcare. We have bold ambitions to reimagine the healthcare experience, setting a new standard for how care is delivered and experienced across the industry. Our growing suite of AI solutions spans ambient AI clinical documentation, provider copilots, autonomous coding, revenue cycle management and more — all designed for providers & administrators to focus on what matters most: providing care.

Healthcare is a $4.5 trillion industry with more than $500 billion spent annually on administrative costs, and Commure is at the heart of transforming it. We power over 500,000 clinicians across hundreds of care sites nationwide – more than $10 billion flows through our systems and we support over 100 million patient interactions. With new product launches on the horizon, expansion into additional care segments, and a bold vision to tackle healthcare's most pressing challenges, our ambition is to move from upstart innovator to the industry standard over the next few years.

Commure was recently named to Fortune's Future 50 list for 2025 and is backed by world-class investors including General Catalyst, Sequoia, Y Combinator, Lux, Human Capital, 8VC, Greenoaks Capital, Elad Gil, and more. Commure has achieved over 300% year-over-year growth for the past two years and this is only the beginning. Healthcare's moment for AI-powered transformation is here, and we're building the technology to power it. Come join us in shaping the future of healthcare.

About the Role

At Commure, our Ambient Scribe team is at the forefront of revolutionizing healthcare technology by building Ambient AI solutions for the entire care journey. We're looking for a talented backend engineer to help take Ambient AI to the next level. If you love working on important, exciting problems in healthcare and love shipping quickly, come join us!

What You'll Do
  • Contribute to the most advanced healthcare platform in the country
  • Help scale infrastructure that supports the largest health systems in the country
  • Be a part of a tremendously fast-paced team that celebrates fast execution and decisions
  • Design eval and AI pipelines that are reliable, reproducible, and extendable
  • Shape model interactions by partnering with engineering and product teams on how models are deployed and measured
  • Work with a stack that includes Python, Flask, Django, FastAPIs and other frameworks
  • Work directly with customers to solve their issues daily
What You Have
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field, or equivalent extensive experience
  • 3+ years of professional software development industry experience
  • Strong Backend Programming Skills (Must be comfortable with Python)
  • Experience in environments where you have to ship quickly. We move fast.
  • Have experience building AI applications, including designing evals and improving performance through prompting or scaffolding
  • Familiar with evaluation methods for LLMs and have worked with patterns like multi-agent workflows, tool use, or long context
  • General Understanding of Containers and Cloud (Docker, Kubernetes)
  • Excitement to work in a high impact field with a builder attitude!
  • Extremely motivated to grow
  • Strong leadership skills

Commure is committed to creating and fostering a diverse team. We are open to all backgrounds and levels of experience, and believe that great people can always find a place. We are committed to providing reasonable accommodations to all applicants throughout the application process.

Please be aware that all official communication from us will come exclusively from email addresses ending in @getathelas.com, @commure.com or @augmedix.com. Any emails from other domains are not affiliated with our organization.

Employees will act in accordance with the organization's information security policies, to include but not limited to protecting assets from unauthorized access, disclosure, modification, destruction or interference nor execute particular security processes or activities. Employees will report to the information security office any confirmed or potential events or other risks to the organization. Employees will be required to attest to these requirements upon hire and on an annual basis.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Evals and AI Infra in San Francisco, CA vacancy
  • $170k - $240k

     ...At Commure, we're building the AI Operating System for...  ...interactions by partnering with engineering and product teams on how models...  ...experience ~3+ years of professional software development industry...  ...applications, including designing evals and improving performance through... 
    Senior
    Work at office
    Immediate start

    Commure

    San Francisco, CA
    16 days ago
  • $170k - $250k

     ...Senior Infra Software Engineer Title of Role: Senior Infra Software Engineer Location: San Francisco, onsite Company Stage of Funding: Seed - Software Development, Devtools, AI Office Type: Onsite Salary: $170K-$250K Company Description We'... 
    Senior
    Work at office

    Recruiting from Scratch

    San Francisco, CA
    1 day ago
  •  ...several extremely talented software engineers across the stack. In...  ...that power Pylon's AI features - prompt executions, search infra, and more! Improve LLM observability - AI evals (online and offline), scorers...  ...technical team of senior engineers from places like... 
    Suggested
    Work at office
    Relocation

    Pylon Labs

    San Francisco, CA
    1 day ago
  • $175k - $225k

     ...Senior Backend Engineer In person 5 days/week in San Francisco, Boston, MA, New York. We are looking...  ...power LangChain's observability and evals platform. You will work on the core...  ...developers to monitor and evaluate their AI applications at scale. While the focus... 
    Senior
    Work at office
    Flexible hours

    LangChain

    San Francisco, CA
    5 days ago
  • $175k - $240k

     ...Senior Fullstack Engineer In person 5 days/week in San Francisco We're looking...  ..., an observability and evals platform. In this role, you'...  ...~5+ years of experience in software engineering working on complex...  ...~ Bonus: Experience with AI/LLM-powered applications, developer... 
    Senior
    Work at office
    Flexible hours

    LangChain

    San Francisco, CA
    5 days ago
  • $240k - $280k

     ...About Sentry Software runs the world and the pace is faster than ever. Sentry helps developers fix...  ...monitoring standard and our team is building its AI-native future. About the role As a Senior Software Engineer on Sentry's AI/ML team, you'll be responsible... 
    Senior
    Hourly pay

    Sentry

    San Francisco, CA
    1 day ago
  • $150k - $250k

    Foundry Robotics Inc. is looking for a Senior Software Engineer to join their team in San Francisco. This vital role focuses on building cloud-based backend systems, infrastructure, and ensuring data integrity in advanced robotics manufacturing. The successful candidate... 
    Senior

    Foundry Robotics Inc.

    San Francisco, CA
    3 days ago
  • $170k - $195k

     ...ubiquitous. We provide the agent engineering platform and open source...  ...developers worldwide and powers AI teams at companies like Replit...  ...London. We are looking for a Senior Backend Engineer to join us. In...  ...LangChain’s observability and evals platform. You will work on the... 
    Senior
    Worldwide
    Flexible hours

    LangChain

    San Francisco, CA
    1 day ago
  •  ...Full-time Department : Engineering and Development...  ...Experience : 0 years Senior Software Engineer (Startup) About...  ...of web apps and modern AI systems. That means we...  ...LLMs—prompt pipelines, evals, guardrails, retrieval...  ...streaming strategies. Infra chops containers, IaC,... 
    Senior
    Full time
    Work at office
    Flexible hours
    Weekend work

    SproutsAI

    San Francisco, CA
    5 days ago
  • $240k - $280k

    Bad software is everywhere, and we’re tired of it. Sentry is on a mission to help developers write better software faster...  ...of software monitoring tools. About the role As a Senior Software Engineer on Sentry’s AI/ML team, you’ll be responsible for building the evaluation... 
    Senior
    Hourly pay
    Work at office

    Sentry

    San Francisco, CA
    2 days ago
  • $261k - $326k

    A technology company specializing in AI infrastructure is seeking a Principal Engineer to enhance reliability and scalability of cloud systems. This role demands over 15 years of experience in production engineering or related fields and involves setting technical directions... 
    Senior

    Crusoe

    San Francisco, CA
    2 days ago
  • $250k - $400k

     ...Founding Engineer Opportunity Location: San Francisco, CA Type...  ...API designed to give inboxes to AI agents and be the sole...  ...engineer with strong backend and infra instincts to help build the primitives...  ...shipping production software by real users as a software engineer... 
    Senior
    Full time
    Work experience placement

    AgentMail (YC S25)

    San Francisco, CA
    3 days ago
  •  ...A tech company specializing in AI infrastructure is seeking a Senior Product Manager for Runpod Anywhere. The role involves leading the entry into a new market and building a product line from scratch, along with engaging customers to refine product strategy. Applicants... 
    Senior
    Remote work

    Runpod

    San Francisco, CA
    4 days ago
  •  ...Amperos Health Amperos Health is healthcare's first AI-native denial management and revenue recovery...  ...you. About the Role We're looking for our first engineer focused on infrastructure to start and lead Infra at Amperos. You'll get to own dev ops, dev experience... 
    Work at office
    Flexible hours

    Amperos Health, Inc

    San Francisco, CA
    1 day ago
  •  ...role offers significant autonomy and the chance to influence investment strategies through innovative systems. You'll collaborate directly with the team on cutting-edge projects involving machine learning and AI. Competitive compensation is provided. #J-18808-Ljbffr... 
    Senior
    Remote work

    One Concern

    San Francisco, CA
    4 days ago
  • Lambda Inc. is seeking an expert in high-performance storage systems in San Francisco. You will design validation plans, draft standard operating procedures, and manage access-control processes. The ideal candidate will have over 8 years of experience in large-scale storage...
    Senior
    Flexible hours

    Lambda Inc.

    San Francisco, CA
    3 days ago
  • A leading AI career network company in San Francisco is seeking a Senior Cloud Engineer to manage and architect scalable cloud infrastructure. The ideal candidate will define best practices for cloud deployments, build CI/CD pipelines, and drive improvements using automation... 
    Senior

    Handshake

    San Francisco, CA
    4 days ago
  •  ...create the next generation of Gen AI-driven code reviewers: a...  ...significantly outperforms individual engineers. We combine language models...  ...to push the boundaries of software development efficiency and quality...  ...alongside AI researchers, infra specialists, frontend engineers... 
    Senior
    Remote work

    CodeRabbit

    San Francisco, CA
    1 day ago
  • A fast-growing AI company in San Francisco is seeking a Senior/Staff Infrastructure Engineer to build and operate cloud infrastructure. This full-time, hybrid role focuses on GCP, Kubernetes, and infrastructure-as-code. You will be responsible for securing deployments and... 
    Senior
    Full time

    Motion Recruitment Partners LLC

    San Francisco, CA
    5 days ago
  •  ...cover that tracks your sleep and uses AI to cool and heat your body to the perfect...  ...located in San Francisco, CA for a Senior Software Engineer. You will be responsible for building on...  ...fleet. Previous experience with backend infra or IoT devices is not required. Culture... 
    Senior
    Full time
    Visa sponsorship

    Orion Sleep

    San Francisco, CA
    5 hours ago
  • A leading AI company in San Francisco is hiring for a role in infrastructure to support their rapid growth. Ideal candidates will have over 5 years of engineering experience and proficiency in managing cloud resources, Kubernetes, and tools like Terraform. Responsibilities... 
    Senior

    LlamaIndex, Inc.

    San Francisco, CA
    3 days ago
  •  ...Software Engineer Opportunity Our client is building the agentic infrastructure for the...  ...financial institutions. They develop AI agents that handle millions of live,...  ...Lead (Series A/B) who built core infra from scratch. - A Senior Engineer who was among the first 10... 
    Senior
    Work at office

    Jetbridge AI

    San Francisco, CA
    1 day ago
  •  ...About Flow Flow Engineering is an AI-native requirements platform that makes complex engineering...  ...the role Flow is hiring a senior frontend software engineer to own core user...  ...work closely with design, product, infra, and AI engineers to make complex systems... 
    Senior
    Flexible hours

    Flow Engineering

    San Francisco, CA
    5 days ago
  • $175k - $240k

     ...our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown... 
    Senior
    Work at office
    Flexible hours

    LangChain, Inc

    San Francisco, CA
    5 days ago
  •  ...Backend Engineer Rippling gives businesses one place to run HR, IT...  ...large language models to build software which helps our internal GTM...  ...Work with other teams to build AI & data-driven GTM products...  ...levels of the stack (foundational infra, backed, UX). You should be able... 
    Senior
    Work at office
    3 days per week

    MyHealthTeam

    San Francisco, CA
    1 day ago
  •  ...hardware, by developing the first AI Hardware Engineer. Our goal is to democratize...  ...first AI Hardware Engineer, software that can design real,...  ...electronics from a prompt. As a Senior Software Engineer, Agentic...  .... Build and analyze evals; translate data into engineering... 
    Senior
    Remote work
    Shift work

    Flux Protocol

    San Francisco, CA
    4 days ago
  • $160k - $300k

    Hebbia, Inc. is looking for a Platform Engineer in San Francisco to design and deploy robust distributed systems that manage billions of tokens. The role requires extensive software development experience and proficiency in technologies like Python and AWS. This position... 
    Senior

    Hebbia, Inc.

    San Francisco, CA
    2 days ago
  • A biotechnology company in San Francisco is seeking a Senior Platform Engineer to build and maintain the cloud infrastructure powering their R&D...  ...CloudFormation. Responsibilities include designing systems for AI operations and ensuring compliance with security standards... 
    Senior

    Orchestra Bio

    San Francisco, CA
    3 days ago
  • A logistics technology company in San Francisco is seeking senior platform engineers to build efficient infrastructure that supports both traditional and AI workloads. The ideal candidate has 3+ years of experience with AWS and infrastructure as code. You will design core... 
    Senior
    Work at office
    3 days per week

    TruckSmarter

    San Francisco, CA
    2 days ago
  • A leading scientific technology firm is seeking a Principal Platform Engineer in San Francisco to design and operate Kubernetes clusters for autonomous AI agents. The role requires over 10 years in platform engineering, hands-on Kubernetes expertise, and experience with... 
    Senior

    Edison Scientific Inc.

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, Evals and AI Infra. Be the first to apply!