Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, Scaling AI Systems

Abridge Al, Inc

About Abridge

Abridge was founded in 2018 with the mission of powering deeper understanding in healthcare. Our AI-powered platform was purpose-built for medical conversations, improving clinical documentation efficiencies while enabling clinicians to focus on what matters most-their patients.

Our enterprise-grade technology transforms patient-clinician conversations into structured clinical notes in real-time, with deep EMR integrations. Powered by Linked Evidence and our purpose-built, auditable AI, we are the only company that maps AI-generated summaries to ground truth, helping providers quickly trust and verify the output. As pioneers in generative AI for healthcare, we are setting the industry standards for the responsible deployment of AI across health systems.

We are a growing team of practicing MDs, AI scientists, PhDs, creatives, technologists, and engineers working together to empower people and make care make more sense. We have offices located in the Mission District in San Francisco, the SoHo neighborhood of New York, and East Liberty in Pittsburgh.


The Role

Abridge's services and engineering team are in hyperscale mode. We are looking for experienced software engineers to join our team and help improve the performance, stability, and scalability of our software by multiples. This is a distributed systems oriented role and is approximately 80% software focused and 20% cloud infrastructure focused.

You will help us build load testing and chaos engineering into our development cycle, leverage observability and profiling tools to identify performance bottlenecks and resolve them, work with diverse teams to help rehome their applications onto more scalable platforms, and ensure a smooth ride as we hyperscale our application adoption in the healthcare space. You may be embedded with application teams for weeks or months.

The platform we are building needs to maximize both engineering velocity and security, will be under tremendous scale, and presents many opportunities to leverage creativity, autonomy, and leadership to take things 0 to 1. This is a unique opportunity in the industry to rapidly grow your career in a rapidly growing company leveraging the best of emerging technologies.

What You'll Do
  • Leverage load testing, chaos engineering, and other test practices to identify performance and latency bottlenecks across all of our systems, and make changes to application code to resolve them.
  • Drive software changes that can rehome applications at the code level onto new infrastructure (run times, event driven infrastructure, databases, and more) in order to dramatically improve scalability as well as enable multi-tenant deployments.
  • Identify and implement software configuration changes and performance tuning parameters that will dramatically improve performance and scalability.
  • Build developer tools and software modules that help engineers build code faster and more effectively with more enablements to the entire engineering organization.
  • Work with the Platform team to develop, and application teams to adopt, emerging elements of our internal developer platform, such as service templates and self-serve infrastructure.
  • Work with application teams to establish and adopt SLOs and error budgets, and drive better metrics for application health that can drive automated canary releases, improved health monitoring, and better engineering practices.
  • Uplevel our ability to respond to incidents by improving observability, runbooks, and incident response muscle across the organization.
  • Evangelize, document, and train the engineering team on the solutions being built and uplevel them on cloud native design strategies and tools.
  • Be a public evangelist for Abridge in the global platform engineering community, including conferences, open source, and research as we pioneer new AI-first cloud-native-first security-first implementations at scale.
Who You Are
  • 8+ years of software engineering experience focused on distributed systems or tooling, with an interest in engineering enablement and software scaling.
  • At least 2 years experience as a back-end engineer focused on system performance and scalability.
  • Experience reducing latency in software by multiples through leveraging observability and profiling tools and deriving great pleasure from doing so.
  • Experience building on Kubernetes and scaling compute services on Kubernetes; experience with related cloud native technologies including ArgoCD, Argo Rollouts, Istio, etc.
  • Comfortable implementing and securing services in Google Cloud Platform with Infrastructure as Code, including GCP Projects, VPC Networks, Google Kubernetes Engine, and IAM Roles, Groups and policies. Candidates without GCP experience but who have experience with Kubernetes are encouraged to apply.
  • Experience building software with backend languages (e.g. Python, GoLang, Node, and Rust).
  • Experience monitoring distributed systems with Prometheus, OpenTelemetry Collector, and Grafana (or something similar), including metrics collection, visualization, alerting, and using observability data to drive performance optimizations.
  • Passion for engineering enablement and solving software and distributed systems scaling challenges under pressure.
Must be willing to travel up to 10%

Abridge typically hosts a three-day builder team retreat every 3-6 months. These retreats often feature internal hackathons, collaborative project sessions, and social events that allow the team to connect in person.

We value people who want to learn new things, and we know that great team members might not perfectly match a job description. If you're interested in the role but aren't sure whether or not you're a good fit, we'd still like to hear from you.
Why Work at Abridge?

At Abridge, we're transforming healthcare delivery experiences with generative AI, enabling clinicians and patients to connect in deeper, more meaningful ways. Our mission is clear: to power deeper understanding in healthcare. We're driving real, lasting change, with millions of medical conversations processed each month.

Joining Abridge means stepping into a fast-paced, high-growth startup where your contributions truly make a difference. Our culture requires extreme ownership-every employee has the ability to (and is expected to) make an impact on our customers and our business.

Beyond individual impact, you will have the opportunity to work alongside a team of curious, high-achieving people in a supportive environment where success is shared, growth is constant, and feedback fuels progress. At Abridge, it's not just what we do-it's how we do it. Every decision is rooted in empathy, always prioritizing the needs of clinicians and patients.

We're committed to supporting your growth, both professionally and personally. Whether it's flexible work hours, an inclusive culture, or ongoing learning opportunities, we are here to help you thrive and do the best work of your life.

If you are ready to make a meaningful impact alongside passionate people who care deeply about what they do, Abridge is the place for you.

How we take care of Abridgers:
  • Generous Time Off : 14 paid holidays, flexible PTO for salaried employees, and accrued time off for hourly employees
  • Comprehensive Health Plans : Medical, Dental, and Vision coverage for all full-time employees and their families.
  • Generous HSA Contribution : If you choose a High Deductible Health Plan, Abridge makes monthly contributions to your HSA.
  • Paid Parental Leave : Generous paid parental leave for all full-time employees.
  • Family Forming Benefits: Resources and financial support to help you build your family.
  • 401(k) Matching : Contribution matching to help invest in your future.
  • Personal Device Allowance : Tax free funds for personal device usage.
  • Pre-tax Benefits: Access to Flexible Spending Accounts (FSA) and Commuter Benefits.
  • Lifestyle Wallet : Monthly contributions for fitness, professional development, coworking, and more.
  • Mental Health Support : Dedicated access to therapy and coaching to help you reach your goals.
  • Sabbatical Leave : Paid Sabbatical Leave after 5 years of employment.
  • Compensation and Equity : Competitive compensation and equity grants for full time employees.
  • ... and much more!
Equal Opportunity Employer

Abridge is an equal opportunity employer and considers all qualified applicants equally without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, or disability.

Staying safe - Protect yourself from recruitment fraud

We are aware of individuals and entities fraudulently representing themselves as Abridge recruiters and/or hiring managers. Abridge will never ask for financial information or payment, or for personal information such as bank account number or social security number during the job application or interview process. Any emails from the Abridge recruiting team will come from an @abridge.com email address. You can learn more about how to protect yourself from these types of fraud by referring to this article. Please exercise caution and cease communications if something feels suspicious about your interactions.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Scaling AI Systems in New York, NY vacancy
  • A leading technology staffing firm is seeking a Software Engineer III to design and build large-scale systems that support millions of users. The ideal candidate will have 5-7 years of experience, a strong programming background, and knowledge of distributed systems and... 
    Senior

    Andiamo

    New York, NY
    4 days ago
  • $165.54k - $205k

     ...Veracity Selfcare is seeking a Senior Software Engineer to design and scale robust systems that will impact thousands of patients. This remote role in the USA emphasizes technical excellence while working within a cross-functional team. The ideal candidate has 5+ years... 
    Senior
    Remote work

    Veracity Selfcare

    New York, NY
    2 days ago
  •  ...builds automated production systems for the garment industry....  ...manipulation, computer vision, AI, industrial controls, and...  ...Role We are hiring a Senior ROS 2 Software Engineer / System Architect to own the...  ...will define how our platform scales from a single customer... 
    Senior
    Full time

    Silana

    New York, NY
    1 day ago
  • $150k - $225k

    A technology firm specializing in AI in New York is seeking a Software Engineer to join their team. The role focuses on building and scaling the Atlas platform, which involves designing multi-agent systems and optimizing performance. Required experience includes 5+ years... 
    Senior
    Relocation package

    Arena Technologies, Inc.

    New York, NY
    1 day ago
  •  ...at the intersection of foundational AI and systems design for real-world impact. Our mission...  ...integrated, and designed for scale. This gives us the rare ability to solve...  ...The Role We're looking for a Senior Software Engineer focused on AI systems to join our Engineering... 
    Senior

    Soris

    New York, NY
    4 days ago
  • $150k - $250k

     ...Senior Software Engineer (Agentic AI / Healthcare) Location: New York, NY (Manhattan), Hybrid (3 days onsite...  ...healthcare organizations , they're scaling quickly and expanding their AI...  ...shaping architecture, shipping production systems, and balancing speed with quality.... 
    Senior
    Work at office
    3 days per week

    NxT Level

    New York, NY
    6 days ago
  • $180k - $220k

     ...integrated funding source network, AI agents and expert advocates,...  ...meet you. As a hands-on AI systems engineer at Atlas Health, you'll...  ...Production infrastructure running at scale If you haven’t shipped AI...  .../ ML Experience 8+ years in software engineering with significant... 
    Senior
    Temporary work
    Work experience placement
    Remote work
    Flexible hours

    Atlas Health

    New York, NY
    2 days ago
  • $212.5k - $250k

     ...Senior Software Engineer II, Design Systems San Francisco, CA; Seattle, WA; New York, NY The Company You'll Join...  ...so you can build, invest, and scale with confidence. Carta's Fund Administration...  ...design system evolves to support AI-driven interfaces. You will update... 
    Senior
    Full time
    Work at office

    Carta

    New York, NY
    1 day ago
  • $170k - $230k

     ...24/7/365. We're rapidly scaling our "Beat the Utility" product...  ...We are seeking a skilled Senior Software Engineer to join our team at David Energy...  ...automatically. These two systems are the core of David Energy...  ...better engineer, including AI-based development tooling such... 
    Senior
    Work at office
    Immediate start
    Remote work
    Flexible hours

    David Energy

    New York, NY
    1 day ago
  • $216k - $270k

     ...Scale GP (Scale Generative AI Platform) is an enterprise-grade Generative AI...  ...We are seeking a strong Senior Full-Stack Engineer to help us build, scale...  ...candidate is deeply grounded in software engineering best...  ...LLMs and machine learning systems. You will solve complex... 
    Senior
    Full time

    Scale AI

    New York, NY
    5 days ago
  • $117.2k - $313.7k

     .... Job Category Software Engineering Job Details About Salesforce...  ...Salesforce is the #1 AI CRM, where humans with...  .... Distributed Systems Software Engineer - Public Cloud (Senior/Lead/Principal) Note...  ...maintaining a large scale distributed systems engineering... 
    Senior

    Salesforce.Com Inc

    New York, NY
    5 days ago
  •  ...growing startup specializing in lead generation for the real estate sector, is looking for a Senior Software Engineer. This pivotal role involves designing and maintaining critical systems, collaborating with teams to deliver impactful solutions, and ensuring the scalability... 
    Senior
    Remote work

    Property Leads LLC

    New York, NY
    2 days ago
  •  ...A leading AI procurement firm is seeking a Senior AI Platform Engineer to build and scale their core platform. The role requires strong backend development skills, proficiency...  ...in Node.js and React, and experience with AI systems. You'll work alongside founding engineers,... 
    Senior
    Remote work

    Negotiateai Inc.

    New York, NY
    2 days ago
  • $140k - $200k

     ...to bring brands to an AI-first future—where...  ...operators, Scrunch has scaled rapidly since commercial...  ...We're looking for a Senior Infrastructure Engineer to join our team....  ...operating the foundational systems that power Scrunch's...  ...in a high-velocity software development... 
    Senior
    Full time
    Work at office
    Remote work
    Home office
    Flexible hours
    Shift work

    Scrunch

    New York, NY
    2 days ago
  • A dynamic technology firm in New York is seeking a talented Senior/Staff level Systems Engineer to develop and scale a dedicated cloud for CI workloads. The role offers an opportunity to solve complex systems problems and build a new CI cloud from the ground up. Candidates... 
    Senior

    Crossing Hurdles

    New York, NY
    4 days ago
  • Clovertalent is seeking a Software Engineer to join a high-growth fintech company in New York. The role involves designing scalable systems that impact borrowers' financial journeys positively. You will work independently on complex problems and contribute to a culture... 
    Senior

    Clovertalent

    New York, NY
    2 days ago
  •  ...A leading dental technology firm is seeking a Senior Software Engineer to join a fully remote team. In this role, you'll design and build...  ...features, focusing on integration with dental insurance systems and AI workflows for billing. The ideal candidate has over 5 years... 
    Senior
    Remote work

    Wisdom

    New York, NY
    2 days ago
  •  ...leading healthcare technology firm is seeking a Senior Software Engineer to modernize clinical and claims data exchange systems. The ideal candidate has over 10 years of...  ...Kubernetes. Responsibilities include architecting and scaling data systems, designing reliable API-driven... 
    Senior
    Remote work
    Flexible hours

    Engage PSG Search

    New York, NY
    2 days ago
  • $204k - $262k

    A leading dating app company is seeking an experienced ML Engineer to join the AI Platform Core team. The role involves developing infrastructure...  ...ideal candidate has over 4 years of experience with large-scale systems and strong programming skills. Competitive salary range is... 
    Senior

    Match Group

    New York, NY
    4 days ago
  • ExaCare AI, based in New York, is searching for a Senior Software Engineer (Platform) to enhance and scale their infrastructure and backend systems. The role demands expertise in TypeScript and PostgreSQL while focusing on operational excellence and system reliability.... 
    Senior
    Flexible hours

    ExaCare AI

    New York, NY
    1 day ago
  • A leading online retail company seeks a Software Development Engineer III to lead software development initiatives and mentor junior developers. Located...  ...Java and AWS services. With a focus on building scalable systems and enhancing team performance, candidates should have... 
    Senior

    Shopbop

    New York, NY
    5 days ago
  • $180k - $230k

     ...Harnham is looking for a Senior Machine Learning Engineer to join their AI-driven technology company, focused on building large-scale ML systems. The role emphasizes production ML over research, involving designing, training, and deploying ML models. Responsibilities include... 
    Remote work

    Harnham

    New York, NY
    2 days ago
  •  .... You will own key infrastructure that powers clinical decision-making. Responsibilities include scaling AWS infrastructure, designing backend services, and ensuring system reliability. Candidates should have experience with distributed architectures and proficiency in... 

    Anterior

    New York, NY
    5 days ago
  •  ...solutions. The ideal candidate will have at least 7 years of software engineering experience, leading technical initiatives, and sound...  ...Java, or Python. The role will involve maintaining large-scale systems and collaborating with cross-functional teams. Offering a... 
    Senior

    Hispanic Alliance for Career Enhancement

    New York, NY
    3 days ago
  • $250k - $330k

    A leading conversational AI platform in New York is seeking a Senior Software Engineer to design and build critical execution systems for AI agents. The role offers significant autonomy and impact in a culture focused on excellence and velocity. Ideal candidates have over... 
    Senior

    Decagon

    New York, NY
    4 days ago
  • $175k - $210k

     ...Welcome systems thinkers. System builds software to help the world see and solve anything as a system, starting...  ...highly motivated and experienced Senior Software Engineer to join our team. The primary...  .... You will work closely with our AI and engineering teams to build resilient... 
    Senior
    Flexible hours

    GrabJobs

    New York, NY
    4 days ago
  • $128k - $204k

     ...- eligible US locations About the role and about you: As Senior Software Engineer, Game Systems, you'll work with a team of talented engineers to ensure...  ...Zwift determines in any stage of our interviews that any AI tools are being used without disclosure or citation, your... 
    Senior
    Full time
    Remote work
    Worldwide

    GrabJobs

    New York, NY
    3 days ago
  •  ...Senior Software Engineer, Trading Systems Jersey City, NJ Type: Contract Category: Development Industry: Financial Services Reference ID...  ...the FIX protocol and FIX engines. ~ Familiarity with AI developer assist tools such as GitHub Copilot. ~ Experience... 
    Senior
    Hourly pay
    Contract work
    Local area

    Eliassen Group

    Jersey City, NJ
    4 days ago
  • $245k - $360k

    A hyper-growth ecommerce leader is seeking a Senior Software Engineer to drive development in New York. This role involves owning complex systems, mentoring junior engineers, and leveraging AI tools to optimize development processes. Candidates should possess 3-5+ years... 
    Senior

    Rokt group

    New York, NY
    3 days ago
  •  ...Get AI-powered advice on this job and more...  .... Job Title: Senior Dot Net Developer (Payment Systems) Location: Remote Duration...  ...and support our scaling needs. Implement solutions...  ...12+ years of software development experience...  ...roles. Full Stack Engineer (L5), N-Tech... 
    Senior
    Contract work
    Remote work

    BayOne Solutions

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, Scaling AI Systems. Be the first to apply!