Senior Backend Engineer, LLM Inference Systems
Inception LLC
Inception in San Francisco is seeking experienced backend engineers to own the systems that serve our diffusion LLMs in production. You will build and operate infrastructure that handles billions of inference requests, optimizing for latency, throughput, cost, and reliability. This role sits at the intersection of ML systems and backend infrastructure, with responsibilities spanning scalable services, model serving, load balancing, canary deployments, and observability tooling to ensure SLA #J-18808-Ljbffr Inception LLC
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Backend Engineer, LLM Inference Systems in San Francisco, CA vacancy
- A leading design technology company in San Francisco is seeking a Senior Software Engineer for Backend (Systems / Infrastructure). You will architect and deliver backend systems to maintain scalability as demand grows. This role involves optimizing APIs, managing GPU workloads...Senior
- An innovative AI company is seeking a Senior Backend Engineer to own their core infrastructure. You will design scalable backend systems and collaborate closely with cross-functional teams to implement the company's technical vision. Ideal candidates have 5+ years of experience...Senior
$130k - $196.5k
...requirements. We on the Pixel Serving team are part of the Identity Engineering teams at LiveRamp. We are LiveRamp’s gateway for all real-time... ..., performance, and maintainability of core production systems.About you:5+ years of professional experience deploying high-performance...SeniorFull timeWork from homeFlexible hoursNight shift- A data-driven technology company located in San Francisco is seeking an experienced backend engineer to own and evolve systems that support machine learning capabilities. The ideal candidate has over 5 years of backend engineering experience and proficiency in Python,...SeniorRelocation package
$215k - $290k
A leading Voice AI startup is seeking a Senior Software Engineer - Backend to shape the core systems for millions of AI-driven conversations. This role involves working with real-time audio and global telephony, leading complex projects, and collaborating across teams....Senior$180k - $270k
...throughput, ultra-low-latency inference engines for large language models or... ...core ML training team and the backend infrastructure team.... ...environments and genuinely enjoy the systems-engineering challenge of squeezing... ...hood familiarity with modern LLM serving frameworks like vLLM,...Full timeWork at officeWorldwidePlaud
San Francisco, CA14 hours ago- ...a Member of Technical Staff to design and operate distributed systems for serving models in production and driving large-scale post-training... ...training loops. You will own the infrastructure enabling fast inference and scalable RL iteration, balancing KV-cache strategies,...Senior
- Causal Labs in San Francisco is seeking an experienced Infrastructure Engineer to build high-throughput inference systems for large-scale evaluation and backtesting against historical physical observations. You will design techniques to improve latency and throughput, optimize...Senior
- Innovaccer seeks a Senior AI Engineer to join our AI team and build production-grade AI systems that solve complex problems at scale. You will design, develop, and deploy AI-powered applications, including LLM-based solutions, AI agents, retrieval-augmented generation...Senior
- MakerMaker.AI is looking for a Senior Machine Learning Systems Engineer in San Francisco. In this role, you will build and operate production inference systems, optimizing for performance and reliability. The ideal candidate will have 3+ years of experience in production...Senior
- ...seeking a Member of Technical Staff to design and optimize inference systems. The role involves managing KV cache allocation and improving... ...various components. Ideal candidates should have strong software engineering skills and experience with ML inference systems,...Senior
- ...Senior Backend EngineerLiteLLM is the world's most popular AI Gateway, trusted... ...looking for a Senior Backend Engineer to help us build rock-solid... ...to cover common attacks on LLM API's / MCP servers /... ...tackle hard bugs and ensure system transparency for end usersWhy...SeniorWorldwide
BerriAI
San Francisco, CA3 days ago - OpenAI in San Francisco is seeking an experienced systems generalist to build an automated inference optimization platform across hardware, compiler, and runtime contexts. You will design the OpenAI-hosted control plane and partner-side software, focusing on reliable long...Senior
$200k - $400k
Overview Job Title: Founding AI Engineer Location: San Francisco, CA (On-site; relocation... ...build, and launch a multi-agent AI system that will redefine the future of... ...skilled at architecting large-scale backend systems, fine-tuning LLM-driven workflows, and delivering...SeniorFull timeImmediate startRelocationVisa sponsorshipRelocation packageFlexible hours- ...Slope Backend Engineer OpportunitySlope builds AI-native credit infrastructure for B... ...and auditable.We are looking for a senior backend engineer to own the systems that make that possible.The RoleYou... ...-the-loop review.Experience with LLM or agent workflows for analyst automation...SeniorRemote work
Slope
San Francisco, CA5 days ago $170k - $200k
...Senior Backend EngineerSan Francisco, California, United StatesTatari is... ...are looking for Senior Backend Engineers to join Tatari and play a key... ...role, you will contribute to system architecture decisions,... ...barExperience evaluating and deploying LLM-based systems in production (...SeniorWork at office2 days per weekTatari
San Francisco, CA3 days ago$209.1k - $234.1k
...the place for you.Role OverviewWe are seeking a senior software engineer with experience in backend API development, deployment on Kubernetes, familiarity... ...running on KubernetesIntegrate GenAI systems including LLM, VectorDB, RAG pipelines, agents, and guardrails...SeniorLocal area$140k - $220k
...- $220,000.00/yr About Our Engineering Team: At David AI, our engineers... .... About This Role As a Senior Backend Engineer at David AI, you’ll... ...scalable services, and keep our systems performant under the weight... .... Deployed ML models for inference in a production environment....SeniorFull timeWork at officeFlexible hoursDavid AI
San Francisco, CA3 days ago- ...Senior Full-Stack EngineerNexaFlow is building a next... ...seeking a Senior Full-Stack Engineer to lead the development... ...that integrates LLM-based analysis into existing... ...APIs into production systems, hands-on experience... ...Python or Node.js for backend; React or Vue for frontend...Senior
Fuku
San Francisco, CA3 days ago - ...Senior Backend Software EngineerAs a Senior Backend Software Engineer on our Diagnostics team, you'll build the part of Regard that... ...closely with some of the top health systems in the country and are leading... ...cloud infrastructure and LLM integrationsExperience working...SeniorWork at officeLocal areaHome officeVisa sponsorshipRelocation package2 days per week1 day per week
REGARD
San Francisco, CA2 days ago - ...voice-to-voice technology and an in-house LLM. The role offers a lucrative package with... ...growth opportunities. Join a high-impact backend team responsible for powering thousands... ...user interviews and cutting-edge AI & LLM systems in production. #J-18808-Ljbffr Crossing...Senior
$200k - $250k
...the United States to help them hire. Title of Role: Senior/Staff Backend Engineer (Platform & AI Systems) Location: San Francisco, CA / New York, NY (... ...including infrastructure modernization to AWS) Develop LLM-powered features for document generation and workflow...SeniorH1bWork at officeRemote workVisa sponsorship3 days per weekRecruiting from Scratch
San Francisco, CA1 day ago- ...presence in San Francisco, we seek engineers who can bridge research breakthroughs and production systems. You will design scalable APIs and optimize GPU inference, collaborating with researchers... ...endpoints rapidly. This role spans backend systems, GPU performance, and...Senior
$200k - $240k
...Job Description Job Description Senior Backend Engineer — AI Healthcare The Opportunity Our... ...enjoys building distributed backend systems, solving difficult infrastructure problems... ...backend infrastructure supporting AI inference, preprocessing, validation, and...SeniorNxT Level
San Francisco, CA18 days ago- ...and help build intelligent, production-grade AI systems that solve complex problems at scale. You will work with product, engineering, and data teams to design, develop, and deploy AI-powered applications, including LLM-based solutions, AI agents, retrieval-augmented generation...
- ...finding disease. This role As a backend software engineer working on our radiology platform,... ...processing radiology image data, running LLM inference tasks to assist users, and... ...ship new features and improve overall system performance and reliability. Participate...Full time
New Lantern
San Francisco, CA14 hours ago - Capital One in San Francisco, CA, seeks a Sr. Mgr, AI Engineering to lead the design, deployment, and optimization of large-scale AI systems in production. You will guide cross-functional teams across engineering, research, and product management to deliver responsible...Senior
$215k - $290k
...at About the Role As a Founding Senior Backend Engineer, you’ll shape the core systems powering millions of AI-driven conversations... ...Retell AI - API That Turns Your LLM Into A Human-Like Voice Agent... ...interviewing at Retell AI by 2x Inferred from the description for this job...SeniorFull timeInternshipWork at officeWork from homeVisa sponsorshipFlexible hours$163k - $246.5k
...organizations, including Vanta, Lyft, and Dropbox. Learn more at semgrep.dev. About the role As a Backend Engineer, you'll work on our backend and infrastructure systems to design, build and maintain a fast and reliable user experience for our customers. You'll...SeniorFull timeCurrently hiringLocal areaRemote workWeekend work3 days per weekSemgrep, Inc.
San Francisco, CA14 hours ago- PLEASE CLICK HERE TO SEE *ALL* OF OUR JOB OPENINGS!Senior Backend EngineerSeeking a Senior Backend Engineer to architect and operate their backend platform that... ...for Fortune 500 clients. You'll build the core systems that power their causation analytics—from data processing...SeniorCasual work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Backend Engineer, LLM Inference Systems. Be the first to apply!
Related searches
- senior backend developer San Francisco, CA
- back-end developer San Francisco, CA
- backend software engineer San Francisco, CA
- remote back end developer San Francisco, CA
- healthcare systems engineer San Francisco, CA
- system engineer contract San Francisco, CA
- system test engineer San Francisco, CA
- senior linux systems engineer San Francisco, CA
- systems engineer San Francisco, CA
- computer system validation engineer San Francisco, CA