LLM Infrastructure Engineer — High-Performance Backend
Harrison Clarke
Harrison Clarke is seeking an AI / Infrastructure Engineer specializing in LLM systems in San Francisco, California. You will design and operate the production backbone for deploying and scaling large language models, ensuring performance and cost efficiency. The role requires 3+ years of experience in infrastructure engineering, proficiency in Python and/or Go, and hands-on skills with Docker and Kubernetes. #J-18808-Ljbffr Harrison Clarke
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the LLM Infrastructure Engineer — High-Performance Backend in San Francisco, CA vacancy
$130k - $175k
...interest in Uncountable Engineering! Description... ...AI. As an LLM Applications Engineer... ...architect of our LLM infrastructure. You won't just... ...to ensure high-fidelity, grounded... ...work across the AI backend and the React frontend... ...processing, and performance optimization....BackendPerformance- The Weights & Biases team in San Francisco is looking for a Senior Software Engineer to design and build generative AI platforms. You will implement APIs and scale backend performance, working closely with users and utilizing techniques like Agentic Workflows and RAG. With...BackendPerformance
$240k - $270k
Sigma Computing Inc. is on the lookout for an experienced engineer to join their team in San Francisco. The role focuses on building innovative solutions using tools like Rust, Go, and Kubernetes, while enhancing data accessibility for users. The position demands a strong...BackendPerformance$225k - $250k
...world's largest engineering organizations and... ...keeping code on your infrastructure. Teams choose... ...inference pipelines, backend APIs, and... ...infrastructure for LLM inference, caching... ...distributed APIs. Build highly reliable and... ...networking, and performance optimization. Proficiency...BackendPerformance- ...Perplexity is an AI-powered answer engine built to serve the world’s... ...designing and operating the high-performance interfaces that expose... ...power everything from real-time LLM queries to enterprise-scale integrations... .... Qualifications 5+ years of backend engineering experience with...BackendPerformanceWorldwide
- ...: Senior Software Engineer - Agentic AI Platform... ...and implement the backend services that... ...enable agents to perform long‑running investigations... ...AI & Enterprise Infrastructure: Create the... ...Kotlin, or Scala) for high‑scale platform... ...." And Ideally: LLM Ops & Evaluation:...BackendPerformanceLive inWork from homeRelocation
$160k - $230k
Senior Software Engineer - Together Cloud Infrastructure Together AI is building the... ...the fastest LLM inference engine with... ...AI cloud platform - a highly available, global, blazing... ...build, and maintain performant, secure, and highly-available backend services/operators that...BackendPerformanceFull timeWork at officeRemote work- ...team of scientists, engineers, and builders is passionate... ...filling in as an infrastructure/backend engineering... ...assets. You’ll join a high-impact, compact team... ...data orchestration for LLM Research Develop and... ...platform reliability and performance Build systems for traceability...BackendPerformanceRemote jobFull time
$148.5k - $223.9k
Salesforce is looking for a Backend Software Engineer to join the Einstein GPT Team.... ...The role involves developing high-quality code for the platform and working on LLM technologies in a fast-paced... ...well as experience in cloud infrastructure and APIs. Salaries range from...Backend$168k - $213k
...re hiring Platform Engineers who build and operate the infrastructure that powers compliance... ...own reliability, performance, and scalability... ...optimize queries, build high‑throughput services... ...write production backend code, design... ...audit logging) AI/LLM infra (prompt orchestration...BackendPerformanceFlexible hoursShift work$120k - $170k
...responsible for building the backend services and “data... ...platform primitives—high‑quality event streams,... ...‑serve so product and engineering teams can easily... .... You’ll also work on LLM‑adjacent services such... ...reliability: SLOs, alerting, performance/cost tuning, incident...BackendPerformanceFull timeInternship$258k - $376k
Manager, Software Engineering - Storage... ...caching and streaming infrastructure. As the Engineering... ...reliability and performance for our data tier... ...infrastructure, platform, or backend engineering teams... ...with AI/LLM‑assisted... ...Experience at a high‑growth product company...BackendPerformanceFull timeRemote workWork from home$216.2k - $270.25k
As a Software Engineer on the ML Infrastructure team, you will design and build platforms for scalable... ...and maintain fault‑tolerant, high‑performance systems for serving LLM workloads at scale. Build an... ...large‑scale, high‑performance backend systems. Strong programming skills...BackendPerformanceFull time$226k - $306k
...charter, we're building the infrastructure that accelerates and... ...skills library. AI Engine: Services that centralize core AI and LLM functionality at... ...and develop the core backend services, APIs, and microservices... ...Excellence: Architect high-performance serving infrastructure...BackendPerformanceContract workRemote work- ...looking for a strong engineer who can build... ...will work with: Backend : Python, FastAPI... ...Modal, Woz Agents/LLM : LangGraph,... ...impact. The work is highly cross‑functional,... ...and the end‑to‑end infrastructure for producing... ...Benefits Bi‑annual performance bonus structure...BackendPerformanceWork at officeRelocation package
$180k - $201k
...team of talented engineers focused on making... ...actions, and cost/performance tradeoffs. Notion’... ...You’ll work across infrastructure, shared libraries,... ...easy to adopt and high-leverage across Notion... ...You’ve worked on LLM, ML platform, data... ...to move across backend, infrastructure, libraries...BackendPerformanceFull timeLocal area$170k - $190k
...center of it. As Engineering Team Lead of our... ...embeddings, retrieval infrastructure, and more Take... ...reliability, performance, and developer experience... ...familiarity with LLM APIs and agent... ...search patterns Backend engineering depth... ..., and hold a high bar for quality Comfort...BackendPerformanceRemote workHome officeFlexible hours- Founding AI Engineer | LLM Systems | $500k+ & Equity | SF / Seattle / LA... ...quality Optimise retrieval performance across precision, recall,... ...agentic workflows Strong Python, backend & systems instincts Hands‑... ...‑tech background preferred High ownership, low ego, strong...BackendPerformanceRelocation
- ...across Brain Co. For every engineer, operator, and... ...closely with security, infrastructure, and product teams to... ...Have 5+ years building backend systems in production,... ...building or operating LLM infrastructure: gateways... ...meaningful equity in a high-growth company Thrive...Backend
$224k - $280k
...is seeking a Staff Machine Learning Infrastructure Engineer to design and implement ML training... ...Francisco. The role involves building high-performance training pipelines and managing... ...software engineering experience, strong backend programming skills, and expertise in...BackendPerformance$120k - $180k
...for a Senior/Staff Full Stack Engineer to architect and build the... ...feels, from Python/FastAPI backends and workflows to the React/TypeScript... ...the full stack to ensure high performance, reliability, and seamless... ...and know how to turn LLM capabilities into fast, trustworthy...BackendPerformanceWork at officeShift work- We’re hiring a Founding Engineer to help build the infrastructure powering a new generation... ...design and build the core backend systems that determine how... ...capable of handling high‑volume, real‑time request... ...including dashboards for performance, fill rates, revenue, and...BackendPerformance
- ...strategy, creativity, and other high‑value tasks. You can learn... ...for a Site Reliability Engineer to take the lead on scaling our... ...ability to dive into unfamiliar backend codebases Comfort with Python... ...the average; ‘exceptional performance is the passing grade.’ Ability...BackendPerformanceFull timeShift work
$130k - $185k
...growth. The Software Engineering Director for AI... ...that underpin high‑visibility client... ...observability, and performance. Collaborate... ...the development of backend and full‑stack systems... ...and infrastructure‑as‑code. Build AI... ...ecosystems, including LLM frameworks, agent...BackendPerformanceWork experience placementSummer holidayWork at officeFlexible hours- Gravity Engineering Services Pvt Ltd. is seeking an experienced API Engineer to join their... ...role involves designing and operating high-performance APIs with a focus on low latency and... ...candidate will have at least 5 years of backend engineering experience with Python, Go...BackendPerformance
- ...Francisco is looking for a Senior Software Engineer to design and scale core platform... ...should possess strong experience in backend engineering, and system design, and... ...closely with diverse teams to optimize performance and ensure high-quality delivery while navigating...BackendPerformance
$175k - $280k
...truly come alive. About The Role Backend Infrastructure at Sesame is a Software Engineering role focused on the bottom half... ...specifically be focused on building high-leverage infrastructure,... ...Database design, scaling, and database performance expertise. Significant...BackendPerformanceFull timeContract workFlexible hours$144k - $240k
...Sciences in San Francisco is seeking an experienced Engineer to join their team. You will design and build high-performance UI and APIs to support cutting-edge scientific... ...Science with 5-8 years of experience in backend development, and is passionate about tackling complex...BackendPerformance- ...environments, strict security requirements, and high expectations for reliability. You’ll... ..., and use cases while maintaining performance and simplicity. Form the foundation of... ...with complex customer environments. Backend-leaning full-stack experience building enterprise...BackendPerformanceFull timeFlexible hours
Sierra
San Francisco, CA17 days ago - ...in San Francisco is seeking a Platform Engineer to enhance scalable systems for high-traffic production environments. You will own the performance and stability of production systems... .... The ideal candidate has 5+ years in backend development, expert-level systems design...BackendPerformanceRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to LLM Infrastructure Engineer — High-Performance Backend. Be the first to apply!
Related searches
- principal infrastructure engineer San Francisco, CA
- infrastructure engineering manager San Francisco, CA
- infrastructure automation engineer San Francisco, CA
- data infrastructure engineer San Francisco, CA
- infrastructure developer San Francisco, CA
- infrastructure engineer San Francisco, CA
- entry level infrastructure engineer San Francisco, CA
- remote infrastructure engineer San Francisco, CA
- lead infrastructure engineer San Francisco, CA
- security infrastructure engineer San Francisco, CA