LLM Infrastructure Engineer Training, Serving & GPU
Yutori
Yutori is building high-performance infrastructure for training, evaluating, and serving large language models used by autonomous agents. The company creates model infrastructure for autonomous web-based tasks in San Francisco, inviting engineers to contribute to cutting-edge ML infrastructure and scalable systems. The role focuses on Python, PyTorch, GPU computing, and distributed training, offering a founding-team environment with equity potential and opportunities for growth in advanced LLM #J-18808-Ljbffr
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the LLM Infrastructure Engineer Training, Serving & GPU in San Francisco, CA vacancy
- ...Sciforium is an AI infrastructure company developing... ..., high-efficiency serving platform. Backed... ...support from AMD engineers the team is scaling... ...are looking for a GPU Cluster Engineer to... ...foundation model training teams and our model... ...Server, TensorRT-LLM) for latency and throughput...TrainingFlexible hours
Sciforium
San Francisco, CA4 hours ago - ...Senior LLM Platform EngineerHandshake is... ...Senior LLM Platform Engineer to join our Data... ...data, ML, and LLM infrastructure behind production... ...orchestration, model serving, shared cloud... ...Triton, PyTorch, or GPU-backed serving.Temporal... ...RL, or other post-training infrastructure....TrainingFull timeWork at officeFlexible hours
Handshake
San Francisco, CA3 days ago $180k - $220k
...Infrastructure Engineer (GPU & Compute)Lightning AI is the company behind PyTorch Lightning. Founded in... ...end-to-end platform for developing, training, and deploying AI systems—designed to... ...observability, and control built in.We serve solo researchers, startups, and large...TrainingWork at officeWork from homeFlexible hours2 days per weekLightning AI
San Francisco, CA4 days ago- ...globe, we offer an innovative GPU marketplace and AI inference... ...We’re seeking a Senior Infrastructure Engineer to help build and scale Hyperbolic... ..., orchestrated pool that serves thousands of AI developers and... ...file systems for training data and checkpoints Proficiency...TrainingRemote work
Devopsroles
San Francisco, CA4 hours ago $175k - $200k
...Senior Infrastructure Operations Engineer New York, New York, United States; Remote;... ...end platform for developing, training, and deploying AI systems—designed... ...control built in. We serve solo researchers, startups,... ...one of the world's largest GPU fleets. Our...TrainingTemporary workFor contractorsWork at officeRemote workWork from homeRelocation packageFlexible hours2 days per weekLightning AI
San Francisco, CA1 day ago- We Are:The Global AI Infrastructure team is at the center... ...powers AI platforms, GPU-accelerated workloads... ...AIaaS, Token-aaS, model serving, and agentic AI... ...and CUDA along with LLM inference engines (TensorRT-LLM), production... ...including multi-node training and inference...TrainingWork experience placementLive inWork at officeLocal area
Accenture
San Francisco, CA4 days ago $200k - $280k
Engineering San Francisco Full-time $200,000 - $280,000... ...the Role Join our ML Infrastructure team to build the systems that train, deploy, and serve our AI models at scale... ...for ML systems Optimize GPU utilization and reduce... ...Have Experience with LLM fine-tuning and deployment...TrainingFull timeWork at office$187k
...builds and operates the infrastructure, tooling, and... ...data scientists and ML engineers to develop, train, deploy, and monitor... ...predictive models to LLM-powered and multi-step... ...Experience operating GPU-based workloads and optimizing... ...of our business, serving as a north star that...TrainingFull timeWork at officeLocal areaRemote workChime
San Francisco, CA5 days ago$130.6k - $192k
...Platform and builds the shared infrastructure that helps DoorDash, Wolt... ...) ourselves — real-time GPU serving, high-throughput batch... ...surfaces including the LLM Gateway, Agent Gateway, evals... ...serving and inference engines, fine-tuning and training pipelines, GPU...TrainingHourly payWork at officeLocal areaRemote workFlexible hoursDoordash
San Francisco, CA2 days ago- ...Seekr is building the infrastructure that powers the next generation... ...AI Infrastructure Engineer, you will design,... ...that enable large-scale training, serving, evaluation, and... ...systems, Kubernetes, GPU infrastructure, high-performance... ..., SGLang, TensorRT-LLM, Triton Inference...TrainingPermanent employmentWork experience placementFlexible hours
Seekr
San Francisco, CA4 days ago $229.9k - $262.4k
...AI Engineer 5 (Gen AI Platform Services - Agentic... ...in technology infrastructure and world-class talent... ...reimagine how we serve our customers and... ...foundation model training, large language... ...systems, tracking GPU utilization, model... ...technologies (e.g. LLM Inference, Similarity...TrainingFull timePart timeLocal areaCapital One
San Francisco, CA4 hours ago- ...real-time financial infrastructure to make cross-... ...meaningful mission—serving a community that has... ...Staff Platform Engineer to lead the platform... ...to end. Treat the LLM and its tools as... ...VPC, private GKE, GPU/gVisor node pools,... ...placement, promotion, training, compensation,...TrainingRemote work
Felix
San Francisco, CA1 day ago $197.3k - $225.1k
...AI Engineer 4 (Gen AI Platform Services) At... ...investments in technology infrastructure and world-class... ...reimagine how we serve our customers and... ...foundation model training, large language... ...engineering to optimize GPU/TPU utilization... ...(e.g. LLM Inference, Similarity...TrainingFull timePart timeLocal areaCapital One
San Francisco, CA1 day ago$231k - $340k
...Overview As a Staff Software Engineer on the Model Infrastructure team, you'll lead the... ...future model evaluation, training, and deployment. Lead cross... ...with AI infrastructure, LLM serving, or machine learning... ...Iceberg. Familiarity with GPU infrastructure or model training...TrainingHarvey, Inc.
San Francisco, CA4 hours ago$7.5k - $15k
...Dynamics builds that AI. Infrastructure decides whether we... ...for evals and training: proprietary, open-... ...and Bedrock, with GPU compute and storage... ...Give Forward Deployed Engineers tooling to do the... ...Infrastructure for LLM and agent systems: model serving, vector databases,...TrainingLocal areaShift workRational Dynamics
Berkeley, CA4 days ago$120k - $200k
...Senior Infrastructure EngineerAt Bland.com, our goal is to empower... ...a Senior Infrastructure Engineer at Bland, you'll help us... ...our AI models, from training pipelines to real-time inference serving across multiple regions.... ...infrastructure, model serving, or GPU computing. Experience...TrainingWork at officeNight shiftBland AI
San Francisco, CA5 days ago$176k - $210k
...Senior Infrastructure EngineerAt Komodo Health, our mission... ...experience. The Healthcare Map serves as our foundation for... ..., forward-deployed engineers, and customer success... ..., integrating LLM-based tools into the SDLC... ...work location, relevant training and certifications,...TrainingFor contractorsWork experience placementWork at officeLocal areaFlexible hoursKomodo Health
San Francisco, CA4 days ago- ...Title: Machine Learning Infrastructure EngineerLocation: San Francisco... ...Learning Infrastructure Engineer to help architect the compute, training, and execution... ...venture capital firms and serving elite technology enterprises... ...across extensive GPU clusters.Build developer...TrainingFull timeWork at officeFlexible hours
Objective Paradigm
San Francisco, CA5 days ago $165k - $250k
...OverviewWe're looking for a hands-on Infrastructure Security Engineer to own security across our cloud... ...— the platform that trains our models and serves millions of generations a day.The... ...isolation for user-deployed apps, GPU cluster security, and model protection...TrainingWork at officeImmediate startRemote workWorldwide3 days per weekHiggsfield AI
San Francisco, CA4 days ago- ...superintelligence stack and operates a datacenter network backbone for large GPU clusters. The role focuses on designing, deploying, and maintaining scalable network fabrics to support training and inference workloads at frontier scale. You will work on Ethernet and...Training
Prime Intellect
San Francisco, CA1 day ago - ...Systems Administrator / DevOps Engineer, you will maintain and build the core infrastructure behind both our model training and our inference cloud.... ...infrastructure, including GPU management and workload... ...Experience deploying and operating LLM serving stacks (e.g., vLLM, SGLang...TrainingWork at officeRemote workRelocation package
Zyphra
San Francisco, CA4 days ago $200k - $300k
...ML Infrastructure EngineerThe company is building one of the leading... ....As an ML Infrastructure Engineer, you'll own critical training and inference... ...deployed, monitored, and served efficiently while continuously... ...throughput, reliability, and GPU utilization across production...TrainingRecruiting from Scratch
San Francisco, CA5 days ago$180k - $220k
...end platform for developing, training, and deploying AI systems—... ..., and control built in. We serve solo researchers, startups,... ...AI is seeking a Senior Infrastructure Software Engineer to join our Infrastructure... ...Lightning AI’s large-scale GPU and bare-metal infrastructure...TrainingWork at officeRemote workWork from homeFlexible hoursLightning AI
San Francisco, CA4 hours ago$224k - $284k
.... We are roboticists, engineers, operators, and builders... ...that connects our GPU compute — building a fast... ...that keeps our training and simulation workloads... ...Collaborate across the infrastructure team to solve cross-discipline... ...only matters if it serves others, and we know...TrainingFull timeWork at officeImmediate startFlexible hoursATOMS Careers page
San Francisco, CA3 days ago$260k - $340k
...Role Overview As the Engineering Manager for Model Infrastructure, you'll lead the team responsible... ...that enables Harvey to train, evaluate, deploy, and... ...with AI infrastructure, LLM serving, or machine learning... ...Experience supporting GPU infrastructure, model training...TrainingHarvey AI
San Francisco, CA1 day ago- ...Specter ML Infrastructure EngineerSpecter's mission is... ...an ML Infrastructure engineer to build and scale the... ...role owns the data, training, deployment, and serving infrastructure for... ...equivalent), including GPU cluster management... ....Familiarity with LLM/VLM serving frameworks...Training
Specter Services LLC
San Francisco, CA5 days ago - ...We’re looking for an experienced HPC infrastructure engineer to lead bringup, administration, and... ...is probably the largest anime AI training cluster in the world . You’ll serve as the bridge between our researchers and the bare GPU machines, helping to make sure that...TrainingWork at officeVisa sponsorship
Spellbrush
San Francisco, CAmore than 2 months ago $230k - $342k
...Software Engineer, Core Network Engineering Location... ...OpenAI’s compute infrastructure — spanning global WAN/... ...used for large‑scale training and inference workloads... ...efficiency and production serving performance. This role... ...and high‑performance GPU interconnects Define...TrainingOpenAI, Inc.
San Francisco, CA4 hours ago- ...Macroscope is building the infrastructure for the next generation... ...development, where engineers direct fleets of agents... ...our growing ML research, training, and inference... ...infrastructure for modern LLM workloads , including inference serving, fine-tuning, and training...TrainingOdd job
Devopsroles
San Francisco, CA4 hours ago $250k - $300k
...only vertically integrated AI infrastructure company built from the... ...seeking Sr. Staff Software Engineers to serve as the Managed Platform Services... ...-native customer profiles (training and inference) to identify... ...— both rule-based and LLM-based — our platform can offer...TrainingPermanent employmentTemporary workShift workCrusoe
San Francisco, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to LLM Infrastructure Engineer Training, Serving & GPU. Be the first to apply!
Related searches
- lead infrastructure engineer San Francisco, CA
- infrastructure developer San Francisco, CA
- infrastructure engineering manager San Francisco, CA
- data infrastructure engineer San Francisco, CA
- remote infrastructure engineer San Francisco, CA
- entry level infrastructure engineer San Francisco, CA
- infrastructure engineer San Francisco, CA
- infrastructure automation engineer San Francisco, CA
- senior infrastructure engineer San Francisco, CA
- security infrastructure engineer San Francisco, CA