Senior LLM Infra Engineer AI Model Serving
NVIDIA
NVIDIA in Santa Clara, CA, is hiring for a senior role focused on LLM serving infrastructure and platform API development. You will own the fine-tuning pipeline, evaluation harness, and observability layers while coordinating with ISVs and CSPs to deploy NVIDIA NIMs at scale. Required: 7+ years in LLM serving infra, deep quantization knowledge, and strong collaboration across teams. A competitive salary and equity benefit package accompany this opportunity. #J-18808-Ljbffr NVIDIA
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior LLM Infra Engineer AI Model Serving in Santa Clara, CA vacancy
$192k - $278k
...multi-year product strategy for AI model serving safety across Google Cloud’s... ...alignment across Engineering, Trust and Safety, Legal, Policy... ...tools or Large Language Model (LLM) interfaces into workflows.Preferred... ...solutions to our users.As a Senior Product Manager for AI Model...Senior$184k - $287.5k
...the unlimited potential of AI to define the next era of computing... ...in Santa Clara, CA!As a Senior Software Engineer, NIM Tools, you will have... ...opportunity to build a groundbreaking model customization and deployment... ...7+ years of experience with LLM serving infrastructure (vLLM, TRT-...SeniorFull time$193.3k - $261.5k
...running a wide range of models and supporting... ...software boundary, our engineers build systematic... ...what's possible in AI acceleration.As... ...a wide variety of LLM model families, including... ...mentorship. Our senior members enjoy one-on... .../offline inference serving with vLLM, SGLang,...SeniorWork experience placementInternshipLocal areaFlexible hours- Build a model customization and deployment lifecycle platform, including... ...'s degree in Computer Science or Engineering and over 7 years of experience with LLM serving infrastructure. Must have deep expertise... ...Benefits: Equity Generous benefits package #J-18808-Ljbffr NVIDIA AISenior
- ...Senior Manager, Sales Engineering AI / GPU Cloud (NeoCloud) Mirantis, an IREN... ...the right cluster, model the real TCO, prove... ...with a customer's ML infra lead, and closed... ...), fine-tuning, and serving; you understand where... ..., Triton / TensorRT-LLM, Base Command, Run:ai...Senior
$184k - $287.5k
...tapping into the unlimited potential of AI to define the next era of computing. An era... ...for a creative and expert Systems Engineer to help us expand NVIDIA's autonomous vehicle... ...systems analysis (e.g. error budget creation, modeling of scenarios), data analysis, and...SeniorFull time$174.72k - $295.68k
...innovation, integrating advanced AI and autonomous driving... ...-time Machine Learning Engineer / Research Scientist to drive the modeling and algorithmic... ...to-end driving models, or LLM/VLM architectures (e.g.,... ...cross-functionally with infra, perception, and planning...SeniorFull time$174.72k - $295.68k
...innovation, integrating advanced AI and autonomous driving technologies... ...We are seeking Machine Learning Engineers with strong expertise in generative modeling and large-scale deep learning systems... ...under an agent's actions, and serving as a learned simulator for training...SeniorFull time- ...areMoveworks is the Agentic AI Assistant platform that... ...LLMs, our proprietary models, and a sophisticated... ...Moveworks’ Reasoning Engine and natural language capabilities... ...for building and serving LLM’s at Moveworks. This... ...learning systems. The ML infra team covers a variety...SeniorWork at officeRemote workFlexible hours
$184k - $287.5k
...seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency. You’ll architect and... ...from the crowdExperience building and optimizing LLM inference engines (e.g., vLLM, SGLang).Hands-...SeniorFull time$160k - $198k
...our team members.What You’ll DoAs a Senior AI Systems Engineer, you will architect, deploy, and manage... ...services required for large-scale AI model training and inference. You will... ...compute scheduling alongside advanced LLM serving engines.Cross-Functional Collaboration...SeniorLocal area$195.2k - $262.2k
...infrastructure for the global AI economy. We are... ...from data and model training through to... .... Built by engineers, for engineers. From... ...inference capabilities. A Senior Applied Scientist... ...in efficient LLM and VLM inference with... ...tooling, or inference-serving frameworks, then...SeniorTemporary workImmediate startRemote work$160k - $198k
...Senior AI Systems EngineerSan Jose, California, United StatesArcher... ...'ll DoAs a Senior AI Systems Engineer, you will architect, deploy,... ...required for large-scale AI model training and inference. You will... ...scheduling alongside advanced LLM serving engines.Cross-Functional...SeniorLocal areaArcher
San Jose, CA4 days ago- ...make every business successful through AI by combining cutting-edge technology,... ...AI silicon for next-generation ML models, including LLMs, on our own hardware. As a Senior Performance Co-design Engineer, you will focus on LLM Serving Studies, analyzing and optimizing serving...Senior
$48 - $72 per hour
Senior Brand Safety Engineering Lead - Ads Join to apply for the Senior... ...Ads role at Jobright.ai Senior Brand Safety... ...using cutting-edge models and infra from xAI. • Lead a team... ...AI infra, and Grok LLM to enhance content detection... ...systems: ads serving, recommendations,...SeniorFull timeFor contractorsH1bWork at officeRemote work- Google Cloud is seeking a Senior Performance Co-Design Engineer for TPU work in Sunnyvale to optimize serving performance of large language models on custom AI silicon. You will analyze current and emerging... ...partners. The role centers on LLM inference latency and throughput,...Senior
$152k - $241.5k
.... The GPU, our invention, serves as the visual cortex of modern... ...a motivated Deep Learning engineer to bring advanced communication technologies into AI stacks, including PyTorch, TRT-LLM, vLLM, SGLang, JAX, etc.... ...working on the latest AI models.Improve AI compilers to...SeniorFull timeRemote work$174.72k - $295.68k
..., integrating advanced AI and autonomous driving... ...strong foundation for LLM deployment and quality... ...is not limited to: LLM model fine tuning, PTQ, QAT,... ...orchestration workflows.Serve as the primary interface... ...programming and software engineering skills.Ability to work...SeniorFull time- ...that extends TensorRT with autoregressive model serving capabilities. Collaborate with teams... ...are essential. Key Skills C++, TensorRT, LLM, VLM, GEMM, CUDA, Attention, MoE, KV Cache... ...Compiler Infrastructure, Robotics, Embedded AI Benefits Equity, Health Insurance #J-188...Senior
- CoreWeave is seeking a Senior Software Engineer on the Systems Engineering team to own and evolve our testing framework. You will harden the Rust core, extend coverage into HPC and Slurm-on-Kubernetes, and ensure fast, hermetic CI at fleet scale. You will build test harnesses...Senior
$188k - $275k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by... ...What You'll Do: The Field Engineering organization at CoreWeave is... ...In this role, you will: Serve as the primary technical point... ...Define and operationalize models for managing customer bare-metal...SeniorPermanent employmentFull timeContract workTemporary workCasual workWork at officeFlexible hoursCoreWeave
Sunnyvale, CA27 days ago$160k - $253k
...data centers are transforming into AI factories, and NVIDIA accelerated computing is the engine of artificial intelligence. Our... ...at scale. We are looking for a Senior Technical Marketing Engineer... ...be doing:In this role, you will serve as the technical voice for NVIDIA...SeniorFull time$229.9k - $262.4k
...Overview Senior Manager, AI Engineering (People Leader) (Gen AI Platform Services)... ...capabilities to reimagine how we serve our customers and... ...millions of customers. Our AI models and platforms empower teams... ...introduce state-of-the-art LLM optimization techniques to...SeniorFull timePart timeLocal areaCapital One
San Jose, CAa month ago$134.5k - $193.5k
...intensive world. From revolutionizing power for AI-driven data centers to ensuring... ...of the 21st century.We are looking for a Senior Engineer, Linux Systems Administrator to join our... ...server and network environment with Nagios.Serves as a resource for the Network Systems...SeniorFull timeWork at officeWorldwide$184k - $287.5k
...NVIDIA is tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU serves as the intelligence behind computers, robots,... ....Partner closely with Data Analytics, Test Engineering, and System Integration & Test teams. Ensure the...SeniorFull time$184k - $287.5k
...forefront of the generative AI revolution! The Algorithmic Model Optimization Team... ...as large language models (LLM) and diffusion models for... ...externally by research and engineering teams alike developing best... ....We are now looking for a Senior Deep Learning Software Engineer...SeniorFull time$138k - $206k
...level challenges posed by future AI/ML workloads. Our team... ...closely with hardware and software engineers to address AI/ML workloads... ...abstractions. We are seeking a Senior LLM Systems Performance Engineer... ...systems, disaggregated serving architectures, and MoE deployments...SeniorWork experience placementWork at officeFlexible hours$224k - $356.5k
NVIDIA is searching for a senior or principal engineer who specializes in building cutting... ...for large-scale foundation model training in the Generalist... ...robot learning, embodied AI, and physics simulation. Our... ...experience at building large-scale LLM and multimodal LLM training...SeniorFull time$224k - $356.5k
NVIDIA is hiring engineers to scale up the introduction of next generation architecture into... ...to stand out from the crowd:Developing ML/AI infrastructure. Developing bare metal as... ...Computing, and Visualization. Our invention serves as the visual cortex of modern computers...SeniorFull time$193.3k - $261.5k
...accelerators. Join us to optimize the latest models to run really fast on the Trainium hardware.As a Sr. Software Development Engineer on the Inference Model Enablement team, you... ...decisions that impact the entire Neuron serving stack* Collaborate with customers, product...SeniorInternshipLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior LLM Infra Engineer AI Model Serving. Be the first to apply!
Related searches
- senior network engineer remote Santa Clara, CA
- senior app developer Santa Clara, CA
- senior manager legal Santa Clara, CA
- sr project manager Santa Clara, CA
- senior account executive Santa Clara, CA
- senior manager strategic initiatives Santa Clara, CA
- senior staff systems engineer Santa Clara, CA
- senior commercial counsel Santa Clara, CA
- senior physical design engineer Santa Clara, CA
- senior data manager Santa Clara, CA