Senior AI Inference & Deployment Systems Engineer
$184k - $356kNvidia Corporation
Nvidia Corporation is seeking a Senior Inference Engineer to advance AIConfigurator, optimizing deployment configurations for large-scale LLM inference on NVIDIA platforms. The role involves building production-quality APIs and collaborating with multiple teams to improve deployment performance. The ideal candidate has a PhD or equivalent experience, 10+ years in software engineering, and strong skills in Python and Rust. Salary ranges from $184K to $356K based on level and experience, with additional equity and benefits offered. #J-18808-Ljbffr Nvidia Corporation
- NVIDIA is seeking a Senior System Software Engineer to enhance its Dynamo-Triton Inference Server. Your responsibilities will include developing GPU-accelerated AI inference software and facilitating the convergence of AI frameworks. Applicants should possess an MS or PhD...Senior
$184k - $287.5k
NVIDIA is seeking AI systems engineers to innovate in the inference systems software stack. The role involves designing and optimizing libraries and kernel technologies, significantly impacting AI workloads. Candidates should have a Master's degree (PhD preferred) and over...Senior$184k - $287.5k
NVIDIA Gruppe is seeking talented AI systems engineers to advance innovative technologies in AI inference systems software. This role involves developing cutting-edge libraries, code generators, and kernel technologies for NVIDIA's architecture, emphasizing high-impact...Senior- Dormont Manufacturing Co in Sunnyvale, California is seeking a Senior Engineer responsible for leading designs and delivering improvements... ...The ideal candidate has 3-8 years of experience in distributed systems, strong coding skills in Python or Go, and familiarity with...Senior
- ...Member of Technical Staff — Inference to push the limits of large-scale AI inference. You will design and optimize core systems that serve frontier... ...The role blends systems engineering, ML infrastructure, and... ...state‑of‑the‑art models are deployed and experienced by users...SeniorWorldwide
- A leading AI infrastructure company in California is seeking a Member of Technical Staff — Inference to design and optimize large-scale AI inference systems. The role demands 5+ years in systems engineering and expertise in large-scale inference systems. Successful candidates...SeniorFlexible hours
$198k - $326k
A prominent tech company in Mountain View is looking for a Sr. Staff Software Engineer in Systems Infrastructure to lead optimizations across AI inference systems. Candidates should have 8+ years of experience in software engineering, extensive knowledge of ML systems,...Senior- ...company in California is seeking a skilled engineer to optimize deep learning frameworks for... ...enhance performance across multi-GPU systems, focus on GPU kernel development, and collaborate... ...GPGPU C++, Triton, and experience with AI frameworks like PyTorch and SGLang. A...SeniorFull time
- 2100 NVIDIA USA is seeking a Senior System Software Engineer to join their GPU-accelerated deep learning software team. This role focuses on developing cutting-edge inference serving software for AI models while collaborating within the open-source community. Ideal candidates...Senior
- Staff Runtime Systems Engineer Hybrid, working onsite at our Santa Clara, CA, headquarters 3 days per week. What You Will Do d-Matrix is developing an AI compute platform focusing on in-memory compute for AI inference in datacenters. This position is for runtime software...Senior3 days per week
- Tensordyne is seeking a Hardware Design Engineer in Sunnyvale, CA, to lead hardware system development. This role offers the chance to own critical aspects of... ...layout, and mechanical design, ensuring high-performance AI products. You will collaborate closely with ASIC,...Senior
- AMD is seeking a senior software engineer who blends deep systems performance work with AI, spanning GPU kernels to distributed training and inference. You’ll influence ROCm and AMD’s AI software strategy while mentoring others and tackling high-impact problems on AMD GPUs...Senior
$160k - $180k
...What You’ll Do As a Senior AI Systems Engineer, you will architect, deploy, and manage the critical infrastructure services required for large-scale AI model training and inference. You will ensure our machine learning platforms are robust and efficient, bridging the...SeniorLocal area- NVIDIA is seeking a Sr. Software Engineer in Santa Clara specializing in AI products for semiconductor inspection. This role focuses on developing production-ready models and inference pipelines designed to enhance semiconductor manufacturing processes. Ideal candidates...Senior
- NVIDIA is seeking a data storage engineer to advance cloud-native storage across AI workloads. You will design storage technologies, client libraries, and... ...hybrid environments. You will optimize training and inference data paths, build observability tooling, and work with...Senior
$135.8k - $237.05k
...love. Our Vector Gamer AI team sits at the... ...scale. We're hiring a Senior Backend Engineer to build and operate... ...operate the distributed systems that power billions... ..., and scalability of inference systems. Join us and... ...Design, develop, and deploy production-grade backend...SeniorWork at officeWorldwideRelocation package- ...seeking an experienced software engineer for its DGXC Data Services... ...infrastructure supporting exabyte-scale AI workloads. You will contribute... ...for GPU-based training and inference jobs. You will design and... ...integrate object stores with file systems, and develop telemetry to...Senior
$181.1k - $318.4k
...truly believe it can. We are the System Intelligent and Machine... ...datasets, ingestion of annotated/inferred data into our systems, and making... ...pro, or an outstanding engineer wanting to expand your horizons... ...experience in machine learning, AI, computer vision, or a related...SeniorRelocation- ScOp Venture Capital is looking for an ML Systems Engineer to optimize LLM inference systems crucial for their AI platform. The role focuses on enhancing performance and efficiency via low-level systems optimization, directly impacting industry leader processes in semiconductor...
$152k - $241.5k
NVIDIA is seeking a Solutions Architect in Santa Clara to enhance AI inference solutions using GPU technology and Kubernetes. You will work with engineering teams to develop enterprise AI solutions. Requirements include over 5 years of experience in Solutions Architecture...Senior$184k - $287.5k
NVIDIA is seeking an experienced AI systems engineer to innovate and develop cutting-edge technologies in AI inference systems. You will design and optimize kernel technologies to accelerate workloads for NVIDIA's hardware architecture. The ideal candidate holds a Master...Senior- ...in Sunnyvale, CA, is seeking a senior ASIC verification expert to... ...processors aimed at generative AI inference acceleration. You will work closely with design engineers, ensuring pre-silicon correctness... ...testing strategies using System Verilog and UVM. This dynamic...SeniorRemote job
- ...innovative projects at the convergence of CUDA and Deep Learning Systems. In this role, you will work collaboratively to explore... ...programming skills, with a focus on enhancing performance in multi-node AI systems. This role offers competitive compensation and equity opportunities...Senior
- A leading AI technology firm in Sunnyvale, California, is hiring a Senior Performance Analyst. You will focus on performance benchmarking... ...and competitive pricing for their inference product. The role requires deep knowledge of ML systems and open-source frameworks, with at...Senior
$176k - $276k
NVIDIA is seeking a Storage Production Engineer based in Santa Clara, California, to design and maintain robust storage solutions... ...experience in distributed storage solutions and AI/ML workflows, ensuring system efficiency and data integrity. With a degree in Computer...Senior- ...and fleet strategy for the AI Inference Service organization, collaborating... ...closely with teams across Engineering, Product, and Operations.... ...include managing daily deployment tracking, leading strategic... ...effective utilization of AI systems. This role offers a unique opportunity...Senior
$147.4k - $272.1k
...California, United States Machine Learning and AI Apple is where individual imaginations... ...ideas into powerful, usable features and systems. We work with the latest AI research and... ...with API design, both for other engineers to use, but also for AI systems. At Apple...SeniorRelocation- A technology solutions provider seeks a Senior Forward Deployed Engineer in Sunnyvale, CA. The role involves collaborating with customers to deliver technical solutions integrating Generative AI, Machine Learning, and Computer Vision. Responsibilities include project management...Senior
- Cerebras Systems, Inc. is looking for a Sr. Member of Technical Staff to design software features that enhance system resiliency... ...environments. The role includes developing scalable AI inference services and deploying cloud-based workflows. Ideal candidates have a master's...Senior
- Advanced Micro Devices is looking for a Senior Product Manager in Santa Clara, CA, to... ...open-source community, and partner with engineering teams to meet customer needs.... ...product management, GPU computing, and AI inference technologies. This role provides an opportunity...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference & Deployment Systems Engineer. Be the first to apply!
- ai engineer Santa Clara, CA
- senior ai engineer Santa Clara, CA
- ai developer Santa Clara, CA
- ai prompt engineer Santa Clara, CA
- ai engineer remote Santa Clara, CA
- ground systems engineer Santa Clara, CA
- advanced systems engineer Santa Clara, CA
- distributed systems engineer Santa Clara, CA
- computer systems engineer Santa Clara, CA
- computer system validation engineer Santa Clara, CA

