Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Backend Engineer, LLM Inference Systems

Inception

Inception in San Francisco is seeking experienced backend engineers to own the systems that serve our diffusion LLMs in production. You will build and operate infrastructure that handles billions of inference requests, optimizing for latency, throughput, cost, and reliability. This role sits at the intersection of ML systems and backend infrastructure, with responsibilities spanning scalable services, model serving, load balancing, canary deployments, and observability tooling to ensure SLA #J-18808-Ljbffr Inception

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Backend Engineer, LLM Inference Systems in San Francisco, CA vacancy
  •  ...A leading design technology company in San Francisco is seeking a Senior Software Engineer for Backend (Systems / Infrastructure). You will architect and deliver backend systems to maintain scalability as demand grows. This role involves optimizing APIs, managing GPU workloads... 
    Senior

    Vizcom

    San Francisco, CA
    5 hours ago
  • $225k - $405k

     ...Icehouseventures is seeking a Senior Backend Engineer to join their innovative team in San Francisco. The role involves building scalable systems that process and analyze massive amounts of data, creating accurate search and retrieval systems, and collaborating closely... 
    Senior

    Icehouseventures

    San Francisco, CA
    5 hours ago
  • An innovative AI company is seeking a Senior Backend Engineer to own their core infrastructure. You will design scalable backend systems and collaborate closely with cross-functional teams to implement the company's technical vision. Ideal candidates have 5+ years of experience... 
    Senior

    Trust In SODA

    San Francisco, CA
    5 days ago
  • $196k - $220.5k

     ...Discord is hiring a Senior Software Engineer in San Francisco to take ownership of critical enforcement systems aimed at keeping users safe. The role involves improving production...  ...across various teams. With a focus on backend services, applicants should have over 4... 
    Senior

    Discord

    San Francisco, CA
    5 hours ago
  • $215k - $290k

     ...A leading Voice AI startup is seeking a Senior Software Engineer - Backend to shape the core systems for millions of AI-driven conversations. This role involves working with real-time audio and global telephony, leading complex projects, and collaborating across teams... 
    Senior

    Retell AI

    San Francisco, CA
    5 hours ago
  • A data-driven technology company located in San Francisco is seeking an experienced backend engineer to own and evolve systems that support machine learning capabilities. The ideal candidate has over 5 years of backend engineering experience and proficiency in Python,... 
    Senior
    Relocation package

    kadence

    San Francisco, CA
    4 days ago
  • $196k - $220.5k

     ...Discord Inc. is seeking a Senior Software Engineer to join the Safety Processing team. This role involves...  ...projects related to enforcement systems that impact millions of users daily. Candidates...  ...should have robust experience in backend engineering, specifically with Python... 
    Senior

    Discord Inc.

    San Francisco, CA
    5 hours ago
  • $180k - $270k

     ...throughput, ultra-low-latency inference engines for large language models or...  ...core ML training team and the backend infrastructure team....  ...environments and genuinely enjoy the systems-engineering challenge of squeezing...  ...hood familiarity with modern LLM serving frameworks like vLLM,... 
    Full time
    Work at office
    Worldwide

    Plaud

    San Francisco, CA
    1 day ago
  •  ...CHAOS Industries is seeking exceptional backend and cloud engineers to design and operate the secure cloud platform behind advanced radar systems. You will work with software, hardware, and systems engineers to ingest, process, and deliver real-time sensor data with low... 
    Senior

    CHAOS Industries

    San Francisco, CA
    5 hours ago
  • $200k - $400k

     ...Overview Job Title: Founding AI Engineer Location: San Francisco, CA (On-site; relocation...  ...build, and launch a multi-agent AI system that will redefine the future of...  ...skilled at architecting large-scale backend systems, fine-tuning LLM-driven workflows, and delivering... 
    Senior
    Full time
    Immediate start
    Relocation
    Visa sponsorship
    Relocation package
    Flexible hours

    Heaven and Hire Recruiting

    San Francisco, CA
    3 days ago
  •  ...Chime is seeking a Senior Software Engineer in Lending to own end-to-end backend systems that connect member-facing lending products with shared platforms. You’ll lead cross-team initiatives, shape architecture, and drive safety, scalability, and reliability across critical... 
    Senior

    Chime

    San Francisco, CA
    5 hours ago
  •  ...Apple Inc. is seeking an experienced database Software Engineer to help develop the next generation of iCloud platform services in San Francisco. You will contribute to FoundationDB-based backend systems that power hundreds of millions of users, focusing on scalability... 
    Senior

    Apple Inc.

    San Francisco, CA
    4 hours ago
  •  ...Alterion is seeking a Senior Software Engineer in San Francisco to design and build core backend and distributed systems. This hands-on role involves technical ownership without people management, directly collaborating with founders on architecture. The ideal candidate... 
    Senior

    Alterion

    San Francisco, CA
    4 hours ago
  •  ...Salesforce is seeking a Senior Member of Technical Staff to lead architecture and engineering standards for AI-powered Agentforce backend services. You will drive design, implement high-throughput systems on cloud infrastructure, and collaborate with PM, Research, and... 
    Senior

    100 Salesforce, Inc.

    San Francisco, CA
    5 hours ago
  • MakerMaker in San Francisco is seeking a Senior ML systems engineer to build and operate production inference systems for large models. You will own performance, profiling, and optimizations to ensure high throughput and low latency in production. You will collaborate... 
    Senior

    MakerMaker

    San Francisco, CA
    2 days ago
  •  ...a Member of Technical Staff to design and operate distributed systems for serving models in production and driving large-scale post-training...  ...training loops. You will own the infrastructure enabling fast inference and scalable RL iteration, balancing KV-cache strategies,... 
    Senior

    Magic AI, Inc

    San Francisco, CA
    4 days ago
  • Causal Labs in San Francisco is seeking an experienced Infrastructure Engineer to build high-throughput inference systems for large-scale evaluation and backtesting against historical physical observations. You will design techniques to improve latency and throughput, optimize... 
    Senior

    Causal Labs

    San Francisco, CA
    2 days ago
  • Innovaccer seeks a Senior AI Engineer to join our AI team and build production-grade AI systems that solve complex problems at scale. You will design, develop, and deploy AI-powered applications, including LLM-based solutions, AI agents, retrieval-augmented generation... 
    Senior

    Innovaccer Analytics

    San Francisco, CA
    6 days ago
  • MakerMaker.AI is looking for a Senior Machine Learning Systems Engineer in San Francisco. In this role, you will build and operate production inference systems, optimizing for performance and reliability. The ideal candidate will have 3+ years of experience in production... 
    Senior

    MakerMaker.AI

    San Francisco, CA
    6 days ago
  •  ...Arcadia is looking for a Senior Software Engineer (AI Agents) in San Francisco. In this pivotal role, you will build core systems for an intelligent automation platform used in operations...  ...will include designing production-grade LLM systems, collaborating closely with the... 
    Senior

    Arcadia

    San Francisco, CA
    12 hours ago
  •  ...seeking a Member of Technical Staff to design and optimize inference systems. The role involves managing KV cache allocation and improving...  ...various components. Ideal candidates should have strong software engineering skills and experience with ML inference systems,... 
    Senior

    Gimlet Labs

    San Francisco, CA
    2 days ago
  • $209.1k - $234.1k

     ...the place for you.Role OverviewWe are seeking a senior software engineer with experience in backend API development, deployment on Kubernetes, familiarity...  ...running on KubernetesIntegrate GenAI systems including LLM, VectorDB, RAG pipelines, agents, and guardrails... 
    Senior
    Local area

    Protegrity

    San Francisco, CA
    3 days ago
  •  ...Senior Backend EngineerLiteLLM is the world's most popular AI Gateway, trusted...  ...looking for a Senior Backend Engineer to help us build rock-solid...  ...to cover common attacks on LLM API's / MCP servers /...  ...tackle hard bugs and ensure system transparency for end usersWhy... 
    Senior
    Worldwide

    BerriAI

    San Francisco, CA
    3 days ago
  • OpenAI in San Francisco is seeking an experienced systems generalist to build an automated inference optimization platform across hardware, compiler, and runtime contexts. You will design the OpenAI-hosted control plane and partner-side software, focusing on reliable long... 
    Senior

    Slope

    San Francisco, CA
    6 days ago
  • $120k - $200k

     ...Kubernetes, Python, PostgreSQL, AWS, LLM/AIYou will play a critical...  ...working on all parts of our backend, from the infra to services, and collaborating with other engineers, designers, and founders. A...  ...Docker and container orchestration systems (e.g. Kubernetes) is a plus.... 
    Senior

    Pump

    San Francisco, CA
    3 days ago
  • $170k - $200k

     ...Senior Backend EngineerTatari is on a mission to revolutionize TV advertising...  ...looking for Senior Backend Engineers to join Tatari and play a key...  ...role, you will contribute to system architecture decisions,...  ...barExperience evaluating and deploying LLM-based systems in production (... 
    Senior
    Work at office
    2 days per week

    Tatari

    San Francisco, CA
    3 days ago
  •  ...Engineer At EvenUpEvenUp is on a mission to close the justice gap using technology and...  ...organization. We build leading LLM-powered systems for the legal industry, transforming how...  ...role operates at the intersection of backend engineering, LLM integration, and hands... 
    Senior
    Work at office
    3 days per week

    EvenUp Inc.

    San Francisco, CA
    3 days ago
  • $140k - $220k

     ...- $220,000.00/yr About Our Engineering Team: At David AI, our engineers...  .... About This Role As a Senior Backend Engineer at David AI, you’ll...  ...scalable services, and keep our systems performant under the weight...  .... Deployed ML models for inference in a production environment.... 
    Senior
    Full time
    Work at office
    Flexible hours

    David AI

    San Francisco, CA
    3 days ago
  • Additive is seeking an experienced backend engineer in San Francisco to own and evolve core ML-enabled systems. You will design, build, and scale services that handle ML inference, monitoring, and tax-related logic, while interfacing with external APIs and data stores.... 

    additiveai

    San Francisco, CA
    4 days ago
  •  ...presence in San Francisco, we seek engineers who can bridge research breakthroughs and production systems. You will design scalable APIs and optimize GPU inference, collaborating with researchers...  ...endpoints rapidly. This role spans backend systems, GPU performance, and... 
    Senior

    Black Forest Labs

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Backend Engineer, LLM Inference Systems. Be the first to apply!