Senior AI Inference Systems Engineer - Dynamo-Triton
NVIDIA
NVIDIA is seeking a Senior System Software Engineer to enhance its Dynamo-Triton Inference Server. Your responsibilities will include developing GPU-accelerated AI inference software and facilitating the convergence of AI frameworks. Applicants should possess an MS or PhD in Computer Science, along with 5+ years of deep learning software experience. Exceptional skills in Rust, C++, and Python are also required. #J-18808-Ljbffr NVIDIA
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior AI Inference Systems Engineer - Dynamo-Triton in Santa Clara, CA vacancy
$152k - $241.5k
We are looking for a Senior System Software Engineer to work on Dynamo-Triton Inference Server. NVIDIA is hiring software engineers for its GPU-accelerated deep learning... ...the world are using GPUs to power a revolution in AI, enabling breakthroughs in problems from image...Senior$184k - $287.5k
NVIDIA Gruppe is seeking talented AI systems engineers to advance innovative technologies in AI inference systems software. This role involves developing cutting-edge libraries, code generators, and kernel technologies for NVIDIA's architecture, emphasizing high-impact...Senior$184k - $287.5k
NVIDIA is seeking AI systems engineers to innovate in the inference systems software stack. The role involves designing and optimizing libraries and kernel technologies, significantly impacting AI workloads. Candidates should have a Master's degree (PhD preferred) and over...Senior- ...company in California is seeking a skilled engineer to optimize deep learning frameworks... ...enhance performance across multi-GPU systems, focus on GPU kernel development, and... ...have strong expertise in GPGPU C++, Triton, and experience with AI frameworks like PyTorch and SGLang. A...SeniorFull time
$184k - $356k
Nvidia Corporation is seeking a Senior Inference Engineer to advance AIConfigurator, optimizing deployment configurations for large-scale LLM inference on NVIDIA platforms. The role involves building production-quality APIs and collaborating with multiple teams to improve...Senior- Dormont Manufacturing Co in Sunnyvale, California is seeking a Senior Engineer responsible for leading designs and delivering improvements... ...The ideal candidate has 3-8 years of experience in distributed systems, strong coding skills in Python or Go, and familiarity with...Senior
- A leading AI infrastructure company in California is seeking a Member of Technical Staff — Inference to design and optimize large-scale AI inference systems. The role demands 5+ years in systems engineering and expertise in large-scale inference systems. Successful candidates...SeniorFlexible hours
- ...is hiring a Member of Technical Staff — Inference to push the limits of large-scale AI inference. You will design and optimize core systems that serve frontier models across thousands of GPUs. The role blends systems engineering, ML infrastructure, and performance optimization...SeniorWorldwide
$198k - $326k
A prominent tech company in Mountain View is looking for a Sr. Staff Software Engineer in Systems Infrastructure to lead optimizations across AI inference systems. Candidates should have 8+ years of experience in software engineering, extensive knowledge of ML systems,...Senior$178.7k - $268.1k
...love. Our Vector Gamer AI team sits at the... ...scale. We’re hiring a Senior Backend Engineer to build and operate... ...operate the distributed systems that power billions... ..., and scalability of inference systems. What You’ll... ...servers like NVIDIA Triton Inference Server. Familiarity...SeniorWork at officeRelocation package- Senior Technical Product Marketing Manager This role... ...will be pivotal in our inference marketing. You will work closely with engineering to understand the technical... ...leadership position in AI inference. What You’ll... ...& optimizations (Dynamo, Triton Inference Server, TensorRT...Senior
$184k - $287.5k
NVIDIA is recruiting a Senior Inference Engineer to advance AIConfigurator ( a system that automatically discovers... ...partners closely with Dynamo, TensorRT-LLM, vLLM,... ...-LLM, vLLM, SGLang, Triton Inference Server, Dynamo... ...facing tools. Agentic AI solutions to solve sophisticated...Senior- 2100 NVIDIA USA is seeking a Senior System Software Engineer to join their GPU-accelerated deep learning software team. This role focuses on developing cutting-edge inference serving software for AI models while collaborating within the open-source community. Ideal candidates...Senior
- Staff Runtime Systems Engineer Hybrid, working onsite at our Santa Clara, CA, headquarters 3 days per week. What You Will Do d-Matrix is developing an AI compute platform focusing on in-memory compute for AI inference in datacenters. This position is for runtime software...Senior3 days per week
- Tensordyne is seeking a Hardware Design Engineer in Sunnyvale, CA, to lead hardware system development. This role offers the chance to own critical aspects of... ...layout, and mechanical design, ensuring high-performance AI products. You will collaborate closely with ASIC,...Senior
- AMD is seeking a senior software engineer who blends deep systems performance work with AI, spanning GPU kernels to distributed training and inference. You’ll influence ROCm and AMD’s AI software strategy while mentoring others and tackling high-impact problems on AMD GPUs...Senior
$160k - $180k
...What You’ll Do As a Senior AI Systems Engineer, you will architect, deploy, and manage the critical infrastructure services required for large-scale AI model training and inference. You will ensure our machine learning platforms are robust and efficient, bridging the...SeniorLocal areaArcher56
San Jose, CA1 day ago$152k - $241.5k
...on developing concrete AI products—models, adaptation workflows, and inference pipelines—building on the... ...delivery of practical systems that operate within... ...looking for a Sr. Software Engineer specializing in systems... ...TensorRT, CUDA, cuDNN, Triton, DeepStream, TAO...SeniorImmediate startShift work- NVIDIA is seeking a data storage engineer to advance cloud-native storage across AI workloads. You will design storage technologies, client libraries, and... ...hybrid environments. You will optimize training and inference data paths, build observability tooling, and work with...Senior
- NVIDIA is seeking a Sr. Software Engineer in Santa Clara specializing in AI products for semiconductor inspection. This role focuses on developing production-ready models and inference pipelines designed to enhance semiconductor manufacturing processes. Ideal candidates...Senior
$184k - $287.5k
...CUDA and Deep Learning Systems. As the complexity and... ...performance for emerging AI workloads. You will be... ...bottlenecks in both training and inference pipelines. Collaborate... ...Science, Computer Engineering, Electrical Engineering... ...and codegen (e.g., Triton, XLA, torch compile) Ways...Senior$181.1k - $318.4k
...truly believe it can. We are the System Intelligent and Machine... ...datasets, ingestion of annotated/inferred data into our systems, and making... ...pro, or an outstanding engineer wanting to expand your horizons... ...experience in machine learning, AI, computer vision, or a related...SeniorRelocation- ...seeking an experienced software engineer for its DGXC Data Services... ...infrastructure supporting exabyte-scale AI workloads. You will contribute... ...for GPU-based training and inference jobs. You will design and... ...integrate object stores with file systems, and develop telemetry to...Senior
$152k - $241.5k
We are now looking for a Senior Software Engineer for Quantized Inference! NVIDIA is seeking software... ...code, e.g., writing Triton kernels, inserting quantize... ...across the team: CI, build systems, training infrastructure,... ...tested code; fluent with AI‑assisted tooling...Senior$332k
We are looking for a Senior leader to orchestrate embedded NVIDIA AI software Go‑To‑Market strategy... ...Implement a leadership Inference go‑to‑market strategy!... ...Providers, OEMs, and Global system integrators to... ...Frameworks (NeMo, Riva, NIMs, Triton, RAPIDS, Omniverse, CUDA...SeniorWorldwide- ScOp Venture Capital is looking for an ML Systems Engineer to optimize LLM inference systems crucial for their AI platform. The role focuses on enhancing performance and efficiency via low-level systems optimization, directly impacting industry leader processes in semiconductor...
- ...computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture... ...LLM and Multimodal inference at scale across multi-GPU... .... THE PERSON: Skilled engineer with strong technical... ...expertise in GPGPU C++, Triton, TileLang or DSL development...Senior
- A leading AI technology firm in Sunnyvale, California, is hiring a Senior Performance Analyst. You will focus on performance benchmarking... ...and competitive pricing for their inference product. The role requires deep knowledge of ML systems and open-source frameworks, with at...Senior
$184k - $287.5k
NVIDIA is seeking an experienced AI systems engineer to innovate and develop cutting-edge technologies in AI inference systems. You will design and optimize kernel technologies to accelerate workloads for NVIDIA's hardware architecture. The ideal candidate holds a Master...Senior$152k - $241.5k
NVIDIA is seeking a Solutions Architect in Santa Clara to enhance AI inference solutions using GPU technology and Kubernetes. You will work with engineering teams to develop enterprise AI solutions. Requirements include over 5 years of experience in Solutions Architecture...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference Systems Engineer - Dynamo-Triton. Be the first to apply!
Related searches
- ai engineer Santa Clara, CA
- senior ai engineer Santa Clara, CA
- ai developer Santa Clara, CA
- ai prompt engineer Santa Clara, CA
- ai engineer remote Santa Clara, CA
- ground systems engineer Santa Clara, CA
- advanced systems engineer Santa Clara, CA
- distributed systems engineer Santa Clara, CA
- computer systems engineer Santa Clara, CA
- computer system validation engineer Santa Clara, CA