Senior AI Inference Engineer — Optimized LLM Deployments
NVIDIA
NVIDIA is seeking a Senior Inference Engineer in Santa Clara, CA to advance AIConfigurator, optimizing deployment configurations for large-scale LLM inference on NVIDIA platforms. This role will involve building production-quality APIs, collaborating across teams, and enhancing software for better GPU and model performance. The ideal candidate will have a degree in Computer Science or a related field, extensive software engineering experience, and strong programming skills in Python and Rust. NVIDIA offers a competitive salary range of $184,000 - $287,500 for Level 4 and $224,000 - $356,500 for Level 5. #J-18808-Ljbffr NVIDIA
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior AI Inference Engineer — Optimized LLM Deployments in Santa Clara, CA vacancy
$184k - $356k
Nvidia Corporation is seeking a Senior Inference Engineer to advance AIConfigurator, optimizing deployment configurations for large-scale LLM inference on NVIDIA platforms. The role involves building production-quality APIs and collaborating with multiple teams to improve...Senior$160k - $180k
...What You’ll Do As a Senior AI Systems Engineer, you will architect, deploy, and manage the critical infrastructure... ...AI model training and inference. You will ensure our... ...—to streamline and optimize the AI development lifecycle... ...alongside advanced LLM serving engines. Cross-Functional...SeniorLocal areaArcher56
San Jose, CA1 day ago$110k - $190k
We are hiring a Senior Software & AI Engineer to build production-grade... ..., implementation, deployment, monitoring, and improvement... ...production Build LLM-powered applications... ...anomaly detection, optimization) Own the full ML... ...training pipelines, inference optimization,...Senior- A leading technology company seeks a Senior Software Engineer to join their AI Networking team in Santa Clara. The role focuses on building machine learning optimization tools for AI workloads across GPU and CPU clusters. Key responsibilities include designing resource...Senior
$152k - $241.5k
...now looking for a Senior Software Engineer for Quantized Inference! NVIDIA is seeking... ...the discovery and deployment of efficient inference... ...engines (vLLM, TRT‑LLM, SGLang). The candidate... ...teams to further optimize throughput and... ...code; fluent with AI‑assisted tooling Experience...Senior- ...responsible and reliable AI systems, changing... ...class applied science and engineering teams to deliver our... ...engineering, and we build and deploy proprietary solutions... ...large language model inference, similarity search,... ...state‑of‑the‑art LLM optimization techniques to improve...SeniorFull timeLocal area
SwiftCruit
San Jose, CA2 days ago $184k - $287.5k
...forefront of the AI revolution, specifically... ...Deep Learning Engineer to bridge the gap... ...algorithms to make LLM/VLM fast, lean,... ...Develop SOTA model optimization techniques, such as... ...performance for production deployments. Implement... ...strategies for inference, including automated...Senior$229.9k - $262.4k
...Overview Sr. Lead AI Engineer (Inference Optimization, FM hosting, AI Platform) Overview: At Capital... ...and AI engineering, and we build and deploy proprietary solutions that are... ...Invent and introduce state-of-the-art LLM optimization techniques to improve the...SeniorFull timePart timeLocal area$184k - $287.5k
NVIDIA is seeking an experienced AI systems engineer to innovate and develop cutting-edge technologies in AI inference systems. You will design and optimize kernel technologies to accelerate workloads for NVIDIA's hardware architecture. The ideal candidate holds a Master...Senior$135.2k - $306.4k
...Senior Principal AI Agent / ML Software Engineer The Senior Principal AI Agent / ML Software... ...autonomous workflows, scalable inference infrastructure, and... ...distributed services optimized for low latency, high... ...reviews, test strategy, deployment automation, incident...SeniorTemporary workFlexible hoursOracle
Santa Clara, CA3 days ago$272k - $425.5k
Principal Software Engineer - Large-Scale LLM Memory and... ...throughput, low-latency inference framework for... ...generative AI and reasoning models... ..., resilient deployment of cutting-edge... ...pools.* Mentor senior and junior engineers... ...especially designs optimized for low latency...Local areaRemote work$184k - $287.5k
NVIDIA is seeking AI systems engineers to innovate in the inference systems software stack. The role involves designing and optimizing libraries and kernel technologies, significantly impacting AI workloads. Candidates should have a Master's degree (PhD preferred) and...Senior$184k - $287.5k
NVIDIA Gruppe is seeking talented AI systems engineers to advance innovative technologies in AI inference systems software. This role involves developing cutting-edge... ...The ideal candidate will design, implement, and optimize kernels while collaborating with cross-...Senior$190k - $250k
...Location Type Hybrid Department AI We are looking for an AI Inference engineer to join our growing team. Our... ...to work on large-scale deployment of machine learning models for... ...novel research and implement LLM inference optimizations Qualifications Experience with...Full time$152k - $241.5k
Senior Software Engineer - Deep Learning Inference What you’ll be doing: Craft and develop robust inferencing software that can be scaled... ...Use C++ and Python to build graph parsers, optimizers, and tools for effective deployment of trained deep learning models. Collaborate...Senior$184k - $356.5k
NVIDIA is looking for a Developer Technology Engineer to drive innovation in AI and accelerated computing. In San Clara, you'll collaborate with internal teams and partners to tackle GPU deployment challenges. Ideal candidates will have 8+ years in GPU profiling, proficiency...Senior- ...Department Robotics Title: Senior Embodied AI Engineer About Us: UnitX builds the... ...inception, UnitX has deployed 1,000+ mission-critical systems... ...evaluated, diagnosed, and optimized for rapid deployment and... ...optimizing ML models for real-time inference on robotic hardware (e.g.,...SeniorFull time
$227k - $300k
...transformation to AI-enabled software-... ...proven by global deployment, we're solving... ...looking for a great Senior Staff AI Engineer to join our... ...devices and model optimization. You will work in... ...., Transformers, LLM, CNN, LSTM, Trees... ...C++ (C++14/17 for inference). ~ Deep proficiency...SeniorWork at officeWorldwideFlexible hoursShift work3 days per week$198k - $326k
...Overview The Responsible AI team at LinkedIn... ...post-training LLM alignment work.... ...centered on trust and optimized for culture,... ...scientists, software engineers, product managers,... ...learning) that can be deployed at enterprise... ...such as membership inference, model inversion,...SeniorFor contractorsWork at officeFlexible hours- ...Description About JazzX AI: Vision:... ...experienced AI Engineer with deep... ...our team as a Senior Staff Architect... ..., and optimization of cutting-edge... ...through production deployment. This includes... ...techniques , including inference-time search,... ...model (LLM) training and fine...SeniorWorldwide
JazzX AI
Los Altos, CA14 days ago - NVIDIA AI in Santa Clara is seeking a Senior Inference Engineer to advance AIConfigurator, a system optimizing performance for LLM inference. The role involves building a core optimization engine and APIs for NVIDIA GPU clusters. Ideal candidates have 10+ years of experience...Senior
$152k - $241.5k
...are looking for a Senior System Software Engineer to work on Dynamo-Triton Inference Server. NVIDIA is... ...a revolution in AI, enabling breakthroughs... ...make design and deployment of new AI models... ...Language Model (LLM) and non-LLM... ...cloud environments, optimizing and balancing...Senior$175.8k - $293k
...this in a simple and optimized way by connecting people... ...for a Principal AI Engineer to architect, build, and... ...orchestration runtimes, and inference serving. Evaluate and... ...traffic, calibrated LLM‑as‑a‑judge graders, and... ...safe and reliable deployments of agents in production...- d-Matrix inc. is looking for a Senior Staff ML Researcher to join our Algo team in Santa Clara, CA. This hybrid position involves... ...week. The successful candidate will develop algorithms for optimizing LLM inference on our DNN accelerators. Ideal applicants should have a MSc...Senior3 days per week
$208k - $327.75k
...Manager to lead strategic AI platform initiatives... ...closely with engineering, architecture, and platform... ...that incorporate LLM‑powered agents, autonomous... ...training, inference optimization, GPU‑accelerated computing... ...across build, test, deployment, and runtime environments...SeniorTemporary work- NVIDIA Gruppe is looking for a skilled engineer to join their TensorRT Edge-LLM team in Santa Clara, California. The role involves developing a state-of-the-art inference framework for large language models and optimizing it for real-time performance on embedded platforms...Senior
$229.9k - $262.4k
...Overview Senior Manager, AI Engineering (People Leader) (Gen AI Platform Services... ..., and we build and deploy proprietary solutions that... ...training, large language model inference, similarity search,... ...introduce state-of-the-art LLM optimization techniques to improve the...SeniorFull timePart timeLocal area$180k - $280k
...potential of generative AI to power the... .... The role: Senior Staff SW Engineer (Systems) What... ...next-generation AI Deployment software. You... ...what it takes to optimize and trade-off various... ...Experience with inference servers/model serving... ...such as TensorRT-LLM, vLLM, SGLang,...SeniorWork experience placement3 days per week- ...headquarters 3 days per week. The role Senior Staff ML Researcher - LLM Algorithmic Optimization What You Will Do d-Matrix is... ...optimize large language model inference on DNN accelerators we develop.... ..., ML researchers, and ML engineers who create and apply advanced algorithmic...Senior3 days per week
$176k - $420k
Tesla’s AI team is pushing the frontier of real... ...intelligence. We train and deploy large‑scale ML systems... ...As part of the Model Optimization group, you will work... ...architecture and engineer algorithmic optimizations... ...make large‑scale model inference fast, reliable, and...Hourly payTemporary workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference Engineer — Optimized LLM Deployments. Be the first to apply!
Related searches
- ai engineer Santa Clara, CA
- senior ai engineer Santa Clara, CA
- ai developer Santa Clara, CA
- ai prompt engineer Santa Clara, CA
- ai engineer remote Santa Clara, CA
- senior app developer Santa Clara, CA
- senior international account manager Santa Clara, CA
- senior magento developer Santa Clara, CA
- senior business development director Santa Clara, CA
- sr marketing manager Santa Clara, CA