Staff Software Engineer, Scaling AI Systems
Abridge
About Abridge
Abridge was founded in 2018 with the mission of powering deeper understanding in healthcare. Our AI-powered platform was purpose-built for medical conversations, improving clinical documentation efficiencies while enabling clinicians to focus on what matters most—their patients.
Our enterprise-grade technology transforms patient-clinician conversations into structured clinical notes in real-time, with deep EMR integrations. Powered by Linked Evidence and our purpose-built, auditable AI, we are the only company that maps AI-generated summaries to ground truth, helping providers quickly trust and verify the output. As pioneers in generative AI for healthcare, we are setting the industry standards for the responsible deployment of AI across health systems.
We are a growing team of practicing MDs, AI scientists, PhDs, creatives, technologists, and engineers working together to empower people and make care make more sense. We have offices located in the Mission District in San Francisco, the SoHo neighborhood of New York, and East Liberty in Pittsburgh.
The Role
Abridge’s services and engineering team are in hyperscale mode. We are looking for experienced software engineers to join our team and help improve the performance, stability, and scalability of our software by multiples. This is a distributed systems oriented role and is approximately 80% software focused and 20% cloud infrastructure focused.
You will help us build load testing and chaos engineering into our development cycle, leverage observability and profiling tools to identify performance bottlenecks and resolve them, work with diverse teams to help rehome their applications onto more scalable platforms, and ensure a smooth ride as we hyperscale our application adoption in the healthcare space. You may be embedded with application teams for weeks or months.
The platform we are building needs to maximize both engineering velocity and security, will be under tremendous scale, and presents many opportunities to leverage creativity, autonomy, and leadership to take things 0 to 1. This is a unique opportunity in the industry to rapidly grow your career in a rapidly growing company leveraging the best of emerging technologies.
What You'll Do
Leverage load testing, chaos engineering, and other test practices to identify performance and latency bottlenecks across all of our systems, and make changes to application code to resolve them.
Drive software changes that can rehome applications at the code level onto new infrastructure (run times, event driven infrastructure, databases, and more) in order to dramatically improve scalability as well as enable multi-tenant deployments.
Identify and implement software configuration changes and performance tuning parameters that will dramatically improve performance and scalability.
Build developer tools and software modules that help engineers build code faster and more effectively with more enablements to the entire engineering organization.
Work with the Platform team to develop, and application teams to adopt, emerging elements of our internal developer platform, such as service templates and self-serve infrastructure.
Work with application teams to establish and adopt SLOs and error budgets, and drive better metrics for application health that can drive automated canary releases, improved health monitoring, and better engineering practices.
Uplevel our ability to respond to incidents by improving observability, runbooks, and incident response muscle across the organization.
Evangelize, document, and train the engineering team on the solutions being built and uplevel them on cloud native design strategies and tools.
Be a public evangelist for Abridge in the global platform engineering community, including conferences, open source, and research as we pioneer new AI-first cloud-native-first security-first implementations at scale.
Who You Are
10+ years of software engineering experience focused on distributed systems or tooling, with an interest in engineering enablement and software scaling.
Experience as a back-end engineer focused on system performance and scalability.
Experience reducing latency in software by multiples through leveraging observability and profiling tools and deriving great pleasure from doing so.
Experience building on Kubernetes and scaling compute services on Kubernetes; experience with related cloud native technologies including ArgoCD, Argo Rollouts, Istio, etc.
Comfortable implementing and securing services in Google Cloud Platform with Infrastructure as Code, including GCP Projects, VPC Networks, Google Kubernetes Engine, and IAM Roles, Groups and policies. Candidates without GCP experience but who have experience with Kubernetes are encouraged to apply.
Experience building software with backend languages (e.g. Python, GoLang, Node, and Rust).
Experience monitoring distributed systems with Prometheus, OpenTelemetry Collector, and Grafana (or something similar), including metrics collection, visualization, alerting, and using observability data to drive performance optimizations.
Passion for engineering enablement and solving software and distributed systems scaling challenges under pressure.
Must be willing to travel up to 10%
Abridge typically hosts a three-day builder team retreat every 3-6 months. These retreats often feature internal hackathons, collaborative project sessions, and social events that allow the team to connect in person.
We value people who want to learn new things, and we know that great team members might not perfectly match a job description. If you’re interested in the role but aren’t sure whether or not you’re a good fit, we’d still like to hear from you.
Why Work at Abridge?
At Abridge, we’re transforming healthcare delivery experiences with generative AI, enabling clinicians and patients to connect in deeper, more meaningful ways. Our mission is clear: to power deeper understanding in healthcare. We’re driving real, lasting change, with millions of medical conversations processed each month.
Joining Abridge means stepping into a fast-paced, high-growth startup where your contributions truly make a difference. Our culture requires extreme ownership—every employee has the ability to (and is expected to) make an impact on our customers and our business.
Beyond individual impact, you will have the opportunity to work alongside a team of curious, high-achieving people in a supportive environment where success is shared, growth is constant, and feedback fuels progress. At Abridge, it’s not just what we do—it’s how we do it. Every decision is rooted in empathy, always prioritizing the needs of clinicians and patients.
We’re committed to supporting your growth, both professionally and personally. Whether it's flexible work hours, an inclusive culture, or ongoing learning opportunities, we are here to help you thrive and do the best work of your life.
If you are ready to make a meaningful impact alongside passionate people who care deeply about what they do, Abridge is the place for you.
How we take care of Abridgers:
Generous Time Off : 14 paid holidays, flexible PTO for salaried employees, and accrued time off for hourly employees
Comprehensive Health Plans : Medical, Dental, and Vision coverage for all full-time employees and their families.
Generous HSA Contribution : If you choose a High Deductible Health Plan, Abridge makes monthly contributions to your HSA.
Paid Parental Leave : Generous paid parental leave for all full-time employees.
Family Forming Benefits: Resources and financial support to help you build your family.
401(k) Matching : Contribution matching to help invest in your future.
Personal Device Allowance : Tax free funds for personal device usage.
Pre-tax Benefits: Access to Flexible Spending Accounts (FSA) and Commuter Benefits.
Lifestyle Wallet : Monthly contributions for fitness, professional development, coworking, and more.
Mental Health Support : Dedicated access to therapy and coaching to help you reach your goals.
Sabbatical Leave : Paid Sabbatical Leave after 5 years of employment.
Compensation and Equity : Competitive compensation and equity grants for full time employees.
... and much more!
Equal Opportunity Employer
Abridge is an equal opportunity employer and considers all qualified applicants equally without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, or disability.
We provide reasonable accommodations throughout the interview process. If you need reasonable accommodation in applying, interviewing, completing any assessment or otherwise participating in the employee selection process, please contact us at View email address on jobs.jobcopilot.com
Staying safe - Protect yourself from recruitment fraud
We are aware of individuals and entities fraudulently representing themselves as Abridge recruiters and/or hiring managers. Abridge will never ask for financial information or payment, or for personal information such as bank account number or social security number during the job application or interview process. Any emails from the Abridge recruiting team will come from an @ abridge.com email address. You can learn more about how to protect yourself from these types of fraud by referring to this article . Please exercise caution and cease communications if something feels suspicious about your interactions.
$272k - $425.5k
Principal Software Engineer – Large-Scale LLM Memory and Storage Systems page is loaded## Principal Software Engineer – Large-Scale LLM Memory and Storage Systemslocations... ...latency inference framework for serving generative AI and reasoning models across multi-node distributed...SuggestedLocal areaRemote work- ...actual workflows in the system. With this data,... ...built Tome, a generative AI presentation product used... ...an experienced senior/staff engineer (5+ years of experience... ...years of experience in software development, with a strong... ...Experience building large-scale, high-performance, and...SuggestedFull timeWork from homeFlexible hours
$242k - $333k
...This work is critical for scaling autonomous driving in a... .... We are looking for engineers who are ambitious and... ...large distributed mapping systems that process sensor... ...Contribute to all phases of the software development cycle... ...intelligence (AI) tools to support parts...SuggestedFull timeTemporary workRelocation package$219k - $263k
...Zoox’s Robot Software Infrastructure team is looking for a senior/staff software engineer to help build the core platform... ...configuration and runtime systems across our autonomous... ...operation at scale. Example Challenges... ...artificial intelligence (AI) tools to support parts...SuggestedFull timeTemporary workRelocation package$184k - $287.5k
...NVIDIA Senior Systems Software Engineer NVIDIA has been transforming computer graphics, PC gaming, and... ...into the unlimited potential of AI to define the next era of computing. An... ...Engineer role, focusing on GPU Performance at Scale. At NVIDIA, this role is uniquely...SuggestedRemote work$170k - $216k
...the Waymo Driver. Our software allows the Waymo Driver... ...sensors, enabling software engineers like you to develop... ...models and techniques at scale. Our mission is to... ...the overall self-driving system. We act as the crucial... ...experience in industrial AI applications involving...Full timeRemote work$183.34k - $205k
...’ve closed Series D funding, scaled past the 200-person mark, and... ...about the team: As a Senior Software Engineer II on the Scale team, you'll... ..., build, and deliver backend systems and APIs . You’ll architect... ...you do too. Experience with AI-assisted development. You're...Full timeWork at officeLocal areaRemote workWork from homeHome officeVisa sponsorshipFlexible hours$190k - $230k
...language models and agentic AI throughout the... ...We're looking for a Staff Engineer to take ownership of cloud... ...reductions in unit cost as we scale. Provide technical... ...Refactor existing systems to enhance scalability... ...at scale. Core software engineering skills, including...Remote work$200k - $300k
...Description We're looking for a Staff Engineer to work across some of the... ...thinking. While distributed systems experience is valuable, we care... ...to use (tracing, metrics, at-scale logging) ~In those school... ...LiveKit is revolutionizing the AI landscape by providing the...Full timeFlexible hours- ...this by building the largest AI-driven healthcare data platform... ...experienced and highly capable AI/ML engineer who is motivated to... ...recommendations Develop LLM/NLU systems to process and extract... ...Build data pipelines that scale efficiently while maintaining...Full timeWork at officeRemote workHome officeFlexible hours2 days per week3 days per week
$325k
...interpretable, and steerable AI systems. We want AI to be safe... ...researchers, engineers, policy experts, and business... ...reliability-minded software engineers and SREs... ...built product stacks, scaled databases, run massive... ...Currently, we expect all staff to be in one of our...Full timeWork at officeVisa sponsorshipFlexible hours- ...Possible. At Pinterest, AI isn't just a feature,... ...team execution, system design, and decision-making... ...Independently drive the full software development lifecycle,... .... Mentor junior engineers on the team and provide... ...engineering experience in large-scale distributed systems....Full timeWork at officeRelocationRelocation package
- ...Mandrel Mandrel is building the AI-native ERP for physical... ...hiring a highly motivated Staff / Senior Software Engineer to join our team in New... ...product, and customer teams to scale our core platform. You will... ..., and ship high-impact systems end-to-end—from initial concept...Full timeRelocation package
$220k - $292k
...includes not just the software used to design, plan,... ..., machines, test systems, and OT networks into... ...out-adapts, and out-scales the traditional defense... ...We are looking for a Staff Software Engineer to join ArsenalOS, the... ...required) Experience with AI/LLM integration -...Full timeTemporary workWork experience placementImmediate start$148k - $249k
...Waabi, founded by AI visionary Raquel Urtasun, is the leader... ...requirements. - Influence system architecture and tooling decisions... ...Waabi builds, monitors, and scales its infrastructure. - Drive... ...Qualifications: - 5+ years software engineering or systems/performance...Remote jobFull timeWork at officeWork from homeFlexible hours$216k - $258k
...potential of their data for AI applications. The... ...critical machine learning systems at leading tech... ...implement solutions to scale our serving platform to... ...Tecton’s query execution engine to support complex, multi... ...and/or highly concurrent software systems ~ Degree in Computer...Full timeRemote workFlexible hours$241k - $284k
...GlossGenius GlossGenius is the AI-powered system behind the world’s most... .... As we continue to scale, we're strengthening our App... ...at scale. As a Staff Frontend Engineer on the App Platform team,... ...into how we build and ship software. Our mission is to provide...Full timeWork at officeHome officeFlexible hours3 days per week- ...interpretable, and steerable AI systems. We want AI to be safe... ...researchers, engineers, policy experts, and business... ...'ll also drive how we scale review through... ...~8+ years of industry software engineering experience... ...Currently, we expect all staff to be in one of our offices...Full timeWork at officeVisa sponsorshipFlexible hours
$405k
...interpretable, and steerable AI systems. We want AI to be safe... ...researchers, engineers, policy experts, and business... ...effectively we can scale Claude to millions of... ...friction in the software development lifecycle... ...Currently, we expect all staff to be in one of our offices...Full timeInternshipWork at officeRemote workVisa sponsorshipFlexible hours$189k - $303k
...searching for an exceptional Staff-level Backend Software Engineer to join the Aurora... ...autonomous vehicle fleets at scale. Our mission is to build the... ...will Design complex systems from the ground up, working... ...within Aurora. Embrace AI tools to add new features...Full timeRemote work- ...for building accurate and performant AI applications at scale in production. Pinecone's mission... ...real-time, low-latency distributed systems for a cutting edge database, with a... ...consistency. Responsibilities: As a Staff Software Engineer, you will be working on the...Full timeLocal areaWork from homeFlexible hours
$250k - $300k
...into platform tools that scale across companies, building an intelligent system that brings modern automation... ...by traditional software. As a Staff Forward Deployed Software Engineer , you will operate as a... ...spanning web, cloud, data, and AI infrastructure, with an eye...Full timeWork at officeLocal areaRemote work$120k - $200k
...This is a job that Jill, our AI Recruiter, is recruiting for on behalf of... ...is to speak to Jack . Senior/Staff Software Engineer Salary: $120,000 - $200,000... ...with the CTO, you will architect and scale an AI-first EHR/EMR system, develop predictive analytics for personalized...Full time$176.4k - $319.72k
...driver, combining cutting-edge AI with automotive-grade... ...clear path to AVs at commercial scale—empowering a safer, richer,... ...About the Role As a Senior/Staff Software Engineer working on driving behavior... ...behavior planning/prediction systems for robots, and a...Odd jobFull timeWork experience placement$216k - $258k
...potential of their data for AI applications. The... ...machine learning systems at leading tech companies... ...orchestration platform. As a staff-level engineer on the Batch Compute... ..., designing, and scaling the core compute... ...experience in building product software systems ~5+ years of...Full timeFlexible hours$210k - $235k
...DISQO for expert insight and AI-driven intelligence about... .... DISQO is hiring a Staff or Sr. Staff Software Engineer to build our GTM AI Brain:... ...turn that strategy into systems that ship. This is a hands... ...DISQO as this capability scales. What we're looking for...Full timeContract workLocal areaFlexible hours$280k - $330k
...Equity (.5% - .7%). As a Staff Software Engineer at Confido, you will spearhead... ...of new features and systems from the ground up. This role... ...You may be working on: AI (computer vision + NLP) powered... ...processing of financial documents Scaling data collection capabilities...Full timeLocal areaRelocation package$320k
...interpretable, and steerable AI systems. We want AI to be safe... ...researchers, engineers, policy experts, and business... ...unattended. As a Software Engineer on the Launch... ...deployment systems at scale and gravitate toward... ..., we expect all staff to be in one of our offices...Full timeWork at officeVisa sponsorshipFlexible hoursShift work$320k - $405k
...interpretable, and steerable AI systems. We want AI to be safe and beneficial... ...of committed researchers, engineers, policy experts, and business... ...: Currently, we expect all staff to be in one of our offices... ...team on just a few large-scale research efforts. And we value...Full timeWork at officeVisa sponsorshipFlexible hours- ...About Fern Fern helps software companies build a world-... ...as well as fast-growing AI companies like... ...About the Role As a Staff Software Engineer at Fern, you’ll build APIs, scale AI infrastructure, and design... ...technical direction: Drive system design decisions around...Full timeWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Software Engineer, Scaling AI Systems. Be the first to apply!
- system performance engineer Remote
- software system engineer Remote
- ground systems engineer Remote
- application system engineer Remote
- advanced systems engineer Remote
- distributed systems engineer Remote
- senior staff systems engineer Remote
- senior linux systems engineer Remote
- sr systems engineer Remote
- computer system validation engineer Remote



