LLM Infrastructure Engineer — Training, Serving & GPU
Yutori
Yutori is building high-performance infrastructure for training, evaluating, and serving large language models used by autonomous agents. The company creates model infrastructure for autonomous web-based tasks in San Francisco, inviting engineers to contribute to cutting-edge ML infrastructure and scalable systems. The role focuses on Python, PyTorch, GPU computing, and distributed training, offering a founding-team environment with equity potential and opportunities for growth in advanced LLM #J-18808-Ljbffr Yutori
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the LLM Infrastructure Engineer — Training, Serving & GPU in San Francisco, CA vacancy
- ...Sciforium is an AI infrastructure company developing... ..., high-efficiency serving platform. Backed... ...support from AMD engineers the team is scaling... ...are looking for a GPU Cluster Engineer to... ...foundation model training teams and our model... ...Server, TensorRT-LLM) for latency and throughput...TrainingFlexible hours
Sciforium
San Francisco, CA1 day ago - ...Work together with engineers, scientists,... ...data is the core infrastructure to AI advancement.... ...data-intensive post-training techniques. We believe... ...is hiring a Senior LLM Platform Engineer... ...orchestration, model serving, shared cloud... ...Triton, PyTorch, or GPU-backed serving. Temporal...TrainingFull timeWork at officeRemote workFlexible hours
- Sciforium is an AI infrastructure company developing next-generation... ..., high-efficiency serving platform. Backed by... ...‑on support from AMD engineers the team is scaling... ...seeking a Senior HPC & GPU Infrastructure Engineer... ...frameworks, and distributed training runtimes (e.g., vLLM...TrainingFlexible hours
- ...Francisco is seeking a Machine Learning Infrastructure Engineer to architect and scale compute, training, and inference pipelines... ...distributed systems across large GPU clusters, collaborate with core... ...platform teams, and drive low-latency serving with high reliability in a fast-...TrainingFull timeFlexible hours
- ...globe, we offer an innovative GPU marketplace and AI inference... ...We’re seeking a Senior Infrastructure Engineer to help build and scale Hyperbolic... ..., orchestrated pool that serves thousands of AI developers and... ...file systems for training data and checkpoints Proficiency...TrainingRemote work
Devopsroles
San Francisco, CA1 day ago $180k - $280k
Build high-performance infrastructure for training, evaluating and serving large language models used... .... What you'll do Build LLM training infrastructure... ...training systems Improve GPU utilization Develop model... ...Strong systems engineering skills Excellent debugging...TrainingFull time$200k - $280k
Engineering San Francisco Full-time $200,000 - $280,000... ...the Role Join our ML Infrastructure team to build the systems that train, deploy, and serve our AI models at scale... ...for ML systems Optimize GPU utilization and reduce... ...Have Experience with LLM fine-tuning and deployment...TrainingFull timeWork at office$187k
...builds and operates the infrastructure, tooling, and... ...data scientists and ML engineers to develop, train, deploy, and monitor... ...predictive models to LLM-powered and multi-step... ...Experience operating GPU-based workloads and optimizing... ...of our business, serving as a north star that...TrainingFull timeWork at officeLocal areaRemote workChime
San Francisco, CA6 days ago$130.6k - $192k
...Platform and builds the shared infrastructure that helps DoorDash, Wolt... ...) ourselves — real-time GPU serving, high-throughput batch... ...surfaces including the LLM Gateway, Agent Gateway, evals... ...serving and inference engines, fine-tuning and training pipelines, GPU...TrainingHourly payWork at officeLocal areaRemote workFlexible hoursDoordash
San Francisco, CA2 days ago- ...StripeStripe is a financial infrastructure platform for... ...that enable ML engineers and data scientists... ...Our scope spans ML training infrastructure, model serving and deployment, feature... ..., scalable CPU and GPU compute... ...infrastructure, model training, LLM fine-tuning, low-...TrainingFlexible hours
Stripe
San Francisco, CA2 days ago $120k - $200k
...the Role As a Senior Infrastructure Engineer at Bland, you'll help us to build... ...supporting our AI models, from training pipelines to real-time inference serving across multiple regions. Integrate... ..., model serving, or GPU computing. Experience with real...TrainingWork at officeNight shiftBland Company
San Francisco, CA22 hours ago- ...Macroscope is building the infrastructure for the next generation... ...development, where engineers direct fleets of agents... ...our growing ML research, training, and inference... ...infrastructure for modern LLM workloads , including inference serving, fine-tuning, and training...TrainingOdd job
Macroscope
San Francisco, CA1 day ago - ...real-time financial infrastructure to make cross-... ...meaningful mission—serving a community that has... ...Staff Platform Engineer to lead the platform... ...to end. Treat the LLM and its tools as... ...VPC, private GKE, GPU/gVisor node pools,... ...placement, promotion, training, compensation,...TrainingRemote work
Felix
San Francisco, CA2 days ago $229.9k - $262.4k
...AI Engineer 5 (Gen AI Platform Services - Agentic... ...in technology infrastructure and world-class talent... ...reimagine how we serve our customers and... ...foundation model training, large language... ...systems, tracking GPU utilization, model... ...technologies (e.g. LLM Inference, Similarity...TrainingFull timePart timeLocal areaCapital One
San Francisco, CA1 day ago$197.3k - $225.1k
...AI Engineer 4 (Gen AI Platform Services) At... ...investments in technology infrastructure and world-class... ...reimagine how we serve our customers and... ...foundation model training, large language... ...engineering to optimize GPU/TPU utilization... ...(e.g. LLM Inference, Similarity...TrainingFull timePart timeLocal areaCapital One
San Francisco, CA2 days ago$231k - $340k
...Overview As a Staff Software Engineer on the Model Infrastructure team, you'll lead the... ...future model evaluation, training, and deployment. Lead cross... ...with AI infrastructure, LLM serving, or machine learning... ...Iceberg. Familiarity with GPU infrastructure or model training...TrainingHarvey, Inc.
San Francisco, CA1 day ago- Seekr is building the infrastructure that powers the next generation... ...AI Infrastructure Engineer, you will design,... ...that enable large-scale training, serving, evaluation, and... ...systems, Kubernetes, GPU infrastructure, high-performance... ..., SGLang, TensorRT-LLM, Triton Inference...TrainingPermanent employmentWork experience placementFlexible hours
- ...Title: Machine Learning Infrastructure EngineerLocation: San Francisco... ...Learning Infrastructure Engineer to help architect the compute, training, and execution... ...venture capital firms and serving elite technology enterprises... ...across extensive GPU clusters.Build developer...TrainingFull timeWork at officeFlexible hours
Objective Paradigm
San Francisco, CA1 day ago $7.5k - $15k
...Dynamics builds that AI. Infrastructure decides whether we... ...for evals and training: proprietary, open-... ...and Bedrock, with GPU compute and storage... ...Give Forward Deployed Engineers tooling to do the... ...Infrastructure for LLM and agent systems: model serving, vector databases,...TrainingLocal areaShift work$180k - $220k
...end platform for developing, training, and deploying AI systems—... ..., and control built in. We serve solo researchers, startups,... ...AI is seeking a Senior Infrastructure Software Engineer to join our Infrastructure... ...Lightning AI’s large-scale GPU and bare-metal infrastructure...TrainingWork at officeRemote workWork from homeFlexible hoursLightning AI
San Francisco, CA1 day ago- ...Systems Administrator / DevOps Engineer, you will maintain and build the core infrastructure behind both our model training and our inference cloud.... ...infrastructure, including GPU management and workload... ...Experience deploying and operating LLM serving stacks (e.g., vLLM, SGLang...TrainingWork at officeRemote workRelocation package
Linuxconfig
San Francisco, CA22 hours ago $260k - $340k
...Role Overview As the Engineering Manager for Model Infrastructure, you'll lead the team responsible... ...that enables Harvey to train, evaluate, deploy, and... ...with AI infrastructure, LLM serving, or machine learning... ...Experience supporting GPU infrastructure, model training...TrainingHarvey AI
San Francisco, CA2 days ago- ...superintelligence stack and operates a datacenter network backbone for large GPU clusters. The role focuses on designing, deploying, and maintaining scalable network fabrics to support training and inference workloads at frontier scale. You will work on Ethernet and...Training
- ...We’re looking for an experienced HPC infrastructure engineer to lead bringup, administration, and... ...is probably the largest anime AI training cluster in the world . You’ll serve as the bridge between our researchers and the bare GPU machines, helping to make sure that...TrainingWork at officeVisa sponsorship
Spellbrush
San Francisco, CAa month ago $230k - $342k
...Software Engineer, Core Network Engineering Location... ...OpenAI’s compute infrastructure — spanning global WAN/... ...used for large‑scale training and inference workloads... ...efficiency and production serving performance. This role... ...and high‑performance GPU interconnects Define...TrainingOpenAI, Inc.
San Francisco, CA1 day ago$250k - $300k
...only vertically integrated AI infrastructure company built from the... ...seeking Sr. Staff Software Engineers to serve as the Managed Platform Services... ...-native customer profiles (training and inference) to identify... ...— both rule-based and LLM-based — our platform can offer...TrainingPermanent employmentTemporary workShift workCrusoe
San Francisco, CA5 days ago- ...for a Sr. or Staff Software Engineer, Infrastructure to join the team that owns... .... On any given day, it serves construction dashboards, running GPU inference on site camera feeds, training models for a lithium extraction... ..., and a growing amount of LLM and agent tooling in...Training
- ...and optimize the AI infrastructure that powers Ambient... ...of infrastructure engineering, production ML systems, LLM/LVM inference, evaluation... ..., throughput, GPU utilization,... ...AI. Improve model-serving architecture, including... ...loops for collecting training data, evaluating model...TrainingFull timeWork at officeLocal areaFlexible hours3 days per week
$300 per month
...vertically integrated AI infrastructure company built from the ground... ...Crusoe, our Production Engineering team ensures the reliability... ...services with a focus on serving and scaling LLM workloadsDefine, measure,... ...teams to optimize large-scale training and inference...TrainingTemporary workCrusoe
San Francisco, CA5 days ago$300 per month
...intelligence. We’re crafting the engine that powers a world... ..., transformative cloud infrastructure. About the Role As... ...& Escalations Serve as highest-level escalation... ...Troubleshoot NCCL, IB, GPU driver/firmware issues, distributed training failures. Support complex...TrainingFull timeTemporary workProducePay
San Francisco, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to LLM Infrastructure Engineer — Training, Serving & GPU. Be the first to apply!
Related searches
- lead infrastructure engineer San Francisco, CA
- infrastructure developer San Francisco, CA
- infrastructure engineering manager San Francisco, CA
- data infrastructure engineer San Francisco, CA
- remote infrastructure engineer San Francisco, CA
- entry level infrastructure engineer San Francisco, CA
- infrastructure engineer San Francisco, CA
- infrastructure automation engineer San Francisco, CA
- senior infrastructure engineer San Francisco, CA
- security infrastructure engineer San Francisco, CA