Senior Backend Engineer, LLM Inference Systems
Inception
Inception in San Francisco is seeking experienced backend engineers to own the systems that serve our diffusion LLMs in production. You will build and operate infrastructure that handles billions of inference requests, optimizing for latency, throughput, cost, and reliability. This role sits at the intersection of ML systems and backend infrastructure, with responsibilities spanning scalable services, model serving, load balancing, canary deployments, and observability tooling to ensure SLA #J-18808-Ljbffr Inception
- ...A leading design technology company in San Francisco is seeking a Senior Software Engineer for Backend (Systems / Infrastructure). You will architect and deliver backend systems to maintain scalability as demand grows. This role involves optimizing APIs, managing GPU workloads...Senior
$225k - $405k
...Icehouseventures is seeking a Senior Backend Engineer to join their innovative team in San Francisco. The role involves building scalable systems that process and analyze massive amounts of data, creating accurate search and retrieval systems, and collaborating closely...Senior- An innovative AI company is seeking a Senior Backend Engineer to own their core infrastructure. You will design scalable backend systems and collaborate closely with cross-functional teams to implement the company's technical vision. Ideal candidates have 5+ years of experience...Senior
$196k - $220.5k
...Discord is hiring a Senior Software Engineer in San Francisco to take ownership of critical enforcement systems aimed at keeping users safe. The role involves improving production... ...across various teams. With a focus on backend services, applicants should have over 4...Senior$215k - $290k
...A leading Voice AI startup is seeking a Senior Software Engineer - Backend to shape the core systems for millions of AI-driven conversations. This role involves working with real-time audio and global telephony, leading complex projects, and collaborating across teams...Senior- A data-driven technology company located in San Francisco is seeking an experienced backend engineer to own and evolve systems that support machine learning capabilities. The ideal candidate has over 5 years of backend engineering experience and proficiency in Python,...SeniorRelocation package
$196k - $220.5k
...Discord Inc. is seeking a Senior Software Engineer to join the Safety Processing team. This role involves... ...projects related to enforcement systems that impact millions of users daily. Candidates... ...should have robust experience in backend engineering, specifically with Python...Senior$180k - $270k
...throughput, ultra-low-latency inference engines for large language models or... ...core ML training team and the backend infrastructure team.... ...environments and genuinely enjoy the systems-engineering challenge of squeezing... ...hood familiarity with modern LLM serving frameworks like vLLM,...Full timeWork at officeWorldwide- ...CHAOS Industries is seeking exceptional backend and cloud engineers to design and operate the secure cloud platform behind advanced radar systems. You will work with software, hardware, and systems engineers to ingest, process, and deliver real-time sensor data with low...Senior
$200k - $400k
...Overview Job Title: Founding AI Engineer Location: San Francisco, CA (On-site; relocation... ...build, and launch a multi-agent AI system that will redefine the future of... ...skilled at architecting large-scale backend systems, fine-tuning LLM-driven workflows, and delivering...SeniorFull timeImmediate startRelocationVisa sponsorshipRelocation packageFlexible hours- ...Chime is seeking a Senior Software Engineer in Lending to own end-to-end backend systems that connect member-facing lending products with shared platforms. You’ll lead cross-team initiatives, shape architecture, and drive safety, scalability, and reliability across critical...Senior
- ...Apple Inc. is seeking an experienced database Software Engineer to help develop the next generation of iCloud platform services in San Francisco. You will contribute to FoundationDB-based backend systems that power hundreds of millions of users, focusing on scalability...Senior
- ...Alterion is seeking a Senior Software Engineer in San Francisco to design and build core backend and distributed systems. This hands-on role involves technical ownership without people management, directly collaborating with founders on architecture. The ideal candidate...Senior
- ...Salesforce is seeking a Senior Member of Technical Staff to lead architecture and engineering standards for AI-powered Agentforce backend services. You will drive design, implement high-throughput systems on cloud infrastructure, and collaborate with PM, Research, and...Senior
- MakerMaker in San Francisco is seeking a Senior ML systems engineer to build and operate production inference systems for large models. You will own performance, profiling, and optimizations to ensure high throughput and low latency in production. You will collaborate...Senior
- ...a Member of Technical Staff to design and operate distributed systems for serving models in production and driving large-scale post-training... ...training loops. You will own the infrastructure enabling fast inference and scalable RL iteration, balancing KV-cache strategies,...Senior
- Causal Labs in San Francisco is seeking an experienced Infrastructure Engineer to build high-throughput inference systems for large-scale evaluation and backtesting against historical physical observations. You will design techniques to improve latency and throughput, optimize...Senior
- Innovaccer seeks a Senior AI Engineer to join our AI team and build production-grade AI systems that solve complex problems at scale. You will design, develop, and deploy AI-powered applications, including LLM-based solutions, AI agents, retrieval-augmented generation...Senior
- MakerMaker.AI is looking for a Senior Machine Learning Systems Engineer in San Francisco. In this role, you will build and operate production inference systems, optimizing for performance and reliability. The ideal candidate will have 3+ years of experience in production...Senior
- ...Arcadia is looking for a Senior Software Engineer (AI Agents) in San Francisco. In this pivotal role, you will build core systems for an intelligent automation platform used in operations... ...will include designing production-grade LLM systems, collaborating closely with the...Senior
- ...seeking a Member of Technical Staff to design and optimize inference systems. The role involves managing KV cache allocation and improving... ...various components. Ideal candidates should have strong software engineering skills and experience with ML inference systems,...Senior
$209.1k - $234.1k
...the place for you.Role OverviewWe are seeking a senior software engineer with experience in backend API development, deployment on Kubernetes, familiarity... ...running on KubernetesIntegrate GenAI systems including LLM, VectorDB, RAG pipelines, agents, and guardrails...SeniorLocal area- ...Senior Backend EngineerLiteLLM is the world's most popular AI Gateway, trusted... ...looking for a Senior Backend Engineer to help us build rock-solid... ...to cover common attacks on LLM API's / MCP servers /... ...tackle hard bugs and ensure system transparency for end usersWhy...SeniorWorldwide
- OpenAI in San Francisco is seeking an experienced systems generalist to build an automated inference optimization platform across hardware, compiler, and runtime contexts. You will design the OpenAI-hosted control plane and partner-side software, focusing on reliable long...Senior
$120k - $200k
...Kubernetes, Python, PostgreSQL, AWS, LLM/AIYou will play a critical... ...working on all parts of our backend, from the infra to services, and collaborating with other engineers, designers, and founders. A... ...Docker and container orchestration systems (e.g. Kubernetes) is a plus....Senior$170k - $200k
...Senior Backend EngineerTatari is on a mission to revolutionize TV advertising... ...looking for Senior Backend Engineers to join Tatari and play a key... ...role, you will contribute to system architecture decisions,... ...barExperience evaluating and deploying LLM-based systems in production (...SeniorWork at office2 days per week- ...Engineer At EvenUpEvenUp is on a mission to close the justice gap using technology and... ...organization. We build leading LLM-powered systems for the legal industry, transforming how... ...role operates at the intersection of backend engineering, LLM integration, and hands...SeniorWork at office3 days per week
$140k - $220k
...- $220,000.00/yr About Our Engineering Team: At David AI, our engineers... .... About This Role As a Senior Backend Engineer at David AI, you’ll... ...scalable services, and keep our systems performant under the weight... .... Deployed ML models for inference in a production environment....SeniorFull timeWork at officeFlexible hours- Additive is seeking an experienced backend engineer in San Francisco to own and evolve core ML-enabled systems. You will design, build, and scale services that handle ML inference, monitoring, and tax-related logic, while interfacing with external APIs and data stores....
- ...presence in San Francisco, we seek engineers who can bridge research breakthroughs and production systems. You will design scalable APIs and optimize GPU inference, collaborating with researchers... ...endpoints rapidly. This role spans backend systems, GPU performance, and...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Backend Engineer, LLM Inference Systems. Be the first to apply!
- remote back end developer San Francisco, CA
- senior backend developer San Francisco, CA
- back-end developer San Francisco, CA
- backend software engineer San Francisco, CA
- backend python developer San Francisco, CA
- senior windows systems engineer San Francisco, CA
- software system engineer San Francisco, CA
- system test engineer San Francisco, CA
- mission system engineer San Francisco, CA
- healthcare systems engineer San Francisco, CA



