Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Backend Engineer

BerriAI

Senior Backend EngineerLiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for a Senior Backend Engineer to help us build rock-solid guardrails and observability tooling at scale.About The RoleYou'll focus on owning our guardrails and logging world-class. You will be in charge of the backend code that ensures all guardrail calls are consistently logged, errors are surfaced to users (not silently swallowed), and our observability instrumentation works for real-world, high-volume traffic. Your attention to detail in areas like latency metrics, logging traceability, and backend guardrail registration will directly impact user trust in our security and compliance features.ResponsibilitiesBuild and scale our product, ensuring performance, reliability, and continuous improvement.Ensure all guardrail and policy enforcement calls (e.g., applyguardrail) are properly logged and traceable through our SpendLogs and relevant database tablesBuild and design CPU-level guardrails to cover common attacks on LLM API's / MCP servers / AgentsIdentify and fix areas where silent failures occur in guardrail creation, registration, and policy application—ensuring robust error handling and transparency to end usersWork with observability integrations, including Datadog, Splunk, Prometheus, and OpenTelemetry, to maintain accurate, configurable, and usable monitoring and logging for backend systemsEnhance observability integrations to work for 1B+ requests/mo., with minimal latency overhead and no memory leaks (e.g. due to cardinality of Prometheus metrics)Collaborate cross-functionally on backend engineering priorities (performance, reliability, security)What We're Looking ForBachelor's or Master's in Computer Science or related field1+ years of experience with Python and backend frameworks (e.g. FastAPI, Flask)Understanding of logging best practices, error handling, and secure backend developmentExposure to monitoring, logging, or metrics platforms (Datadog, Splunk, Prometheus, OpenTelemetry)Familiarity with database integration and troubleshooting (PostgreSQL, Redis, etc.)Driven to deliver high-quality backend code with strong guardrails, auditing, and debugging capabilitiesEagerness to tackle hard bugs and ensure system transparency for end usersWhy Join LiteLLM?High-impact, mission-critical work on the core of compliance and reliabilityContribute directly to features used by enterprise customers at global scaleFast-paced growth environment with room for technical ownershipCompetitive salary, health, dental, and vision benefitsAbout LiteLLMLiteLLM ( is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.Ready to shape the future of secure, observable AI infrastructure? Apply now!

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Backend Engineer in San Francisco, CA vacancy
  •  ...Senior Backend EngineerWe believe owning a home should feel as special as the moments that take place within them. If our mission inspires...  ...you.About the RoleWe're hiring a founding Senior Backend Engineer to help us design, develop, and ship robust backend systems that... 
    Senior

    CASA

    San Francisco, CA
    2 days ago
  •  ...agents. We’re growing and looking for a key member of our core engineering team. About the role We are one of the only companies in...  ..., you’ll focus on building robust, scalable, and efficient backend solutions that enable developers to create production-grade AI... 
    Senior

    XPANDER

    San Francisco, CA
    4 days ago
  •  ...About The RoleWe're looking for a top-tier Backend Engineer to join our tech team and work hand-in-hand with our CTO, Denis Charrier, and the rest of the tech team.Your core responsibilities will be to:Build and operate large-scale, distributed systems powering AI-ready... 
    Senior

    Linkup Inc

    San Francisco, CA
    2 days ago
  • $160k - $200k

     ...Mid-to-Senior Backend EngineerOG.com is a fast-growing, CFTC-regulated Prediction Market platform powered by cutting-edge technology. We...  ...in 2022.We are seeking a highly skilled Mid-to-Senior Backend Engineer to spearhead the growth of our 24/7 high-throughput infrastructure... 
    Senior

    Crypto

    San Francisco, CA
    5 hours ago
  • $180k - $220k

     ...Senior Backend EngineerTitle of Role: Senior Backend EngineerLocation: San Francisco, hybridCompany Stage of Funding: Venture - Series...  ...services landscape through data-driven insights and robust engineering practices.What You Will DoDesign and implement scalable backend... 
    Senior

    Recruiting from Scratch

    San Francisco, CA
    2 days ago
  •  ...Senior Backend EngineerOrchestra helps companies navigate the journey from discovery to medicine by connecting science, operations, and...  ..., metabolic disease, and biomanufacturing. We're looking for engineers who are excited about building software that helps scientific... 
    Senior

    Orchestra Bio, Inc

    San Francisco, CA
    2 days ago
  •  ...of identity with a team that holds a high bar for itself — keep reading.Socure is seeking a highly skilled and experienced Senior Software Engineer to join our dynamic engineering team within the Technology Center of Excellence. In this critical role, you will be a... 
    Senior

    Socure Inc

    San Francisco, CA
    2 days ago
  •  ...every customer's instance, balancing extreme flexibility with transactional integrity.Build a Git-style version-control + migration engine capable of rolling forward/back complex schema and data changes on live production tenants in enterprise settings.Engineer AI-... 
    Senior
    Work at office
    Immediate start
    Flexible hours

    Doss

    San Francisco, CA
    2 days ago
  •  ...Senior Backend EngineerHybrid (2 days in office) - Bay Area, United StatesAbout FalconFalcon Labs turns the post-transaction experience into...  ...platforms (Shopify and others) and ad networksAnalytics Engine: Time-series data processing with multi-dimensional revenue reportingData... 
    Senior
    Work at office

    Falcon Labs

    San Francisco, CA
    2 days ago
  •  ...At SAIVA AI, we are transforming senior and post-acute care by turning millions of real...  ...experienced healthcare technology leaders, engineers, and data scientists. We use advanced...  ...Description We are seeking a hands-on Senior Backend Platform Engineerwith strong experience... 
    Senior

    SAIVA AI

    San Francisco, CA
    4 days ago
  • $180k - $190k

     ...Senior Software EngineerPavilion is on a mission to improve the lives of all Americans by making public purchasing work better...  ...government space.We're recruiting a Senior Software Engineer with strong backend and data skills to join our tight-knit, dynamic engineering... 
    Senior
    Contract work
    Work at office
    Local area
    Remote work
    3 days per week

    Pavilion

    San Francisco, CA
    1 day ago
  •  ...Senior Backend EngineerLocation: San Francisco, CA Employment Type: Full-time Experience: 4+ years Focus: Backend Engineering, AI-Native Analytics, Data Infrastructure, Distributed SystemsAbout Our ClientOur client is building the next generation of AI-native business... 
    Senior
    Full time

    NxT Level

    San Francisco, CA
    2 days ago
  • $164k

    # Senior Backend EngineerNashSan Francisco (Hybrid)Full-timeUpload your resume once and Scout applies for youApply with ScoutShare this...  ...APIs.## How this job comparesCompared with 1,635 open senior engineering jobs on October 10, 2026.Pay: This job does not publish its... 
    Senior
    Permanent employment
    Remote work
    Shift work

    We Love AI Jobs

    San Francisco, CA
    3 days ago
  •  ...Senior Backend Engineer (Python) At some point in the future, every business will answer their phone with voice AI. We are making sure that when they build that AI agent, the experience of doing so doesn’t suck. We’re growing incredibly fast and need someone who thrives... 
    Senior
    Work at office
    Worldwide
    Flexible hours

    Phonely

    San Francisco, CA
    4 days ago
  • $147k - $192k

     ...Backend Engineer Baselayer is the intelligent business identity platform that helps verify any business, automate KYB, and monitor real...  ...Salary Range $147k – $192k + Equity - 0.05% – 0.25% Seniority Level Mid‑Senior level Employment Type Full‑time... 
    Senior
    Full time
    Work at office
    Flexible hours
    3 days per week

    BASELAYER

    San Francisco, CA
    23 hours ago
  • $100k - $225k

     ...Senior Backend EngineerSan Francisco, CAAt Mesh, our mission is to enable consumers to pay and be paid with any asset. Today, trillions of...  ..., useful, and ubiquitous. We combine a powerful orchestration engine with a seamless consumer app to unlock liquidity for the world... 
    Senior
    Work at office
    Remote work
    2 days per week

    MESH

    San Francisco, CA
    4 days ago
  •  ...Life as an Engineer at EvenUpJoin EvenUp's AI Platform team, dedicated to making large language models (LLMs) more accessible, scalable...  ...our clients every day.This role operates at the intersection of backend engineering, LLM integration, and hands-on experimentation. You... 
    Senior
    Full time
    Temporary work
    Work at office
    Local area
    Home office
    Flexible hours
    3 days per week

    EvenUp Inc.

    San Francisco, CA
    2 days ago
  • $160k - $200k

     ...prototyping and iteration.What You'll DoAdd functionality to backend systems to support enhancements of our customer-facing portalsSupport...  ...with a high level of autonomy and responsibilityPerformance engineering experience, including instrumentation, profiling, and... 
    Senior
    Work at office
    Remote work

    MyOme

    San Francisco, CA
    5 days ago
  •  ...borrowers.What We're Looking ForDesire to work collaboratively. Engineers participate in the product development cycle from start to...  ...our customers' problems.Who You Are5+ years of experience with backend or full stack solutions (e.g., Go (Preferred), TypeScript, Java... 
    Senior
    Work at office
    Remote work

    Yendo

    San Francisco, CA
    2 days ago
  • $166.6k - $208.3k

     ...Senior Backend Engineer - ProductSince the dawn of aviation, pilots have faced the constant challenge of air resistance, much like sailors navigating the friction of water. Amidst this relentless struggle, the trim tab emerges as an ingenious yet understated marvel. Just... 
    Senior

    Mercury

    San Francisco, CA
    2 days ago
  • $170k - $200k

     ...Senior Backend EngineerSan Francisco, California, United StatesTatari is on a mission to revolutionize TV advertising. Founded in 2016 to...  ...enters its next major era.We are looking for Senior Backend Engineers to join Tatari and play a key role in the evolution and scaling... 
    Senior
    Work at office
    2 days per week

    Tatari

    San Francisco, CA
    2 days ago
  • $230k - $280k

     ...Senior Backend EngineerSan Francisco, CAHealthcare is broken at the first step: patients can't find the right care, understand what it...  ...Full-time / Onsite (5 days/week)About The RoleAt Mochi, our engineering team operates with exceptional leverage. We believe in high... 
    Senior
    Full time
    Casual work
    Work at office
    Remote work
    Weekday work

    Mochi Health

    San Francisco, CA
    2 days ago
  •  ...Giga Backend Engineer OpportunityThis role is on-site in San Francisco in the Dogpatch neighborhood.About GigaGiga has recently raised a $...  ...to our browser use agent in lieu of formal customer APIsAs a senior engineer, you'll be expected to make sound technical decisions... 
    Senior

    Giga AI, Inc.

    San Francisco, CA
    2 days ago
  • $187k - $220k

     ...Senior Backend EngineerSmall businesses represent 99.9% of all companies, yet they're still forced to choose between clunky, outdated enterprise phone systems or their personal phones. This multi-billion dollar market has been overlooked for decades, left to cobble together... 
    Senior
    Remote work
    Flexible hours

    Quo

    San Francisco, CA
    1 day ago
  •  ...Senior Frontend EngineerScribe is where exceptional people come to do the best work of their careers. More than 94% of the Fortune 5...  ...our mission to transform how people do work.As a Senior Frontend Engineer, you'll own a product area end to end, from design through the... 
    Senior
    Full time
    Temporary work
    Work at office
    Home office

    Scribe

    San Francisco, CA
    1 day ago
  •  ...Senior Backend EngineerNourish is looking for talented Senior Backend Engineers to join our fast-growing team! As a key, early member of Nourish's engineering team, you'll play a pivotal role in shaping the future of our core platform. Working side-by-side with engineering... 
    Senior
    Full time
    Work at office
    Remote work

    Nourish Inc

    San Francisco, CA
    2 days ago
  • Caseware is seeking a Senior Software Developer III to lead architecture and drive high-quality, scalable cloud-native software in a fully remote setting. You will mentor engineers, shape OpenAPI and APIs, and guide AI-assisted development and SDLC improvements across... 
    Senior
    Remote job

    Remote

    San Francisco, CA
    4 days ago
  • $170k - $240k

     ...Senior Backend Engineer (Python)Senior Backend Engineer (Python) Company: BHO Tech Location: Bay Area (Hybrid) Compensation: $170K–$240K + bonus + equity (DOE)About BHO Tech BHO Tech partners with high-growth startups to build world-class engineering teams. We work with... 
    Senior

    BHO Tech

    San Francisco, CA
    2 days ago
  •  ...payments, inventory, claims, signatures, ledgers - and we need engineers who find that stake motivating rather than terrifying. What...  ...tenant data path. MongoDB (Atlas in production) behind a pluggable backend interface, plus a PostgreSQL backend that models every object... 
    Senior
    Contract work

    Supero

    San Francisco, CA
    18 hours ago
  • $180k - $220k

     ...Senior Backend Engineer (Python)Title of Role: Senior Backend Engineer (Python)Location: San Francisco, CA, On-siteCompany Stage of Funding: A — Administrative and Support ServicesOffice Type: On-siteSalary: $180K–$220KCompany DescriptionWe're representing a Series A voice... 
    Senior

    Recruiting from Scratch

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Backend Engineer. Be the first to apply!