Senior AI Inference Systems Engineer (GPU, Open Source)
Jobleads-US
NVIDIA Corporation is seeking a Senior System Software Engineer to advance Dynamo, its GPU-accelerated deep learning inference platform. You will develop open-source software for AI model inference, expand disaggregated serving, and optimize latency and throughput across NVIDIA's distributed inference stack.
Ideal candidates have a PhD or equivalent, strong Rust/Python skills, and experience with LLM API semantics. This role is hybrid in the Santa Clara area, with equity and benefits offered.
#J-18808-Ljbffr Jobleads-USVacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior AI Inference Systems Engineer (GPU, Open Source) in Santa Clara, CA vacancy
- ...NVIDIA Corporation’s Local AI team is building software that optimizes LLM inference on edge AI hardware. You’ll evaluate open-source frameworks, map models to GPU architecture, and drive performance characterization across multi-node configurations. You will own validation...SeniorLocal area
- ...Solutions Architect focused on AI inference to design and deploy scalable inference... ...pipelines on Kubernetes and GPU clusters. You will collaborate with engineering and customer teams to deliver... ...and production-grade inference systems. You will optimize models with...Senior
- ...NVIDIA Corporation in Santa Clara, CA, seeks a Sr. Inference Engineer to accelerate LLM inference through GPU kernel optimization. You will lead kernel benchmarking, model-level performance analysis, and AI-driven optimization workflows across silicon and software stacks...Senior
- ...About the Central AI OrgOur organization... ...Conversational AI system that integrates... ...About This RoleAs a Senior ML System Engineer on the AI & ML Platform’s Inference team, you will design... ...optimizations (GPU kernels, quantization... ...to fine‑tune open-source LLMs and deploy...SeniorWork at officeLocal area
Atlassian
Mountain View, CA1 day ago - ...NVIDIA is seeking an experienced Solutions Architect to redefine AI inference infrastructure. You will lead high-stakes engagements, design... ...collaboration with partners to push performance and reliability across GPU clusters and cloud environments. You will work with Dynamo,...Senior
- ...world-leading technology company for AI and Bitcoin mining infrastructure.... ...Position Overview We are seeking a Senior GPU Systems & Fabric Engineer to serve as the critical bridge... ...vGPU) to enable efficient multi-tenant inference workloads and maximize cluster...SeniorFull timeLocal area
Bitdeer
San Jose, CA7 days ago $184k - $287.5k
...platform upon which every new AI-powered application is... .... We are seeking a Senior Software Engineer - AI Inference Performance to advance... ...limits on NVIDIA GPU-accelerated systems. Your work will span models... ...contribute improvements to open-source inference engines and...SeniorFull timeNvidia
Santa Clara, CA4 days ago$184k - $287.5k
...wants to change how the AI inference industry works. With... ...architectures adopted by 10k+ gpu clusters. You’ll teach... ..., distinguished engineers and datacenter... ...scale their businesses, systems and infrastructure. This... .... Contributions to open-source projects relevant to the...Senior$160k - $253k
...transforming into AI factories, and NVIDIA... ...computing is the engine of artificial intelligence... ...are looking for a Senior Technical Marketing... ...NVIDIA's GPU architecture, server... ...efficiency for AI inference & training. What... ...translate complex system design into compelling...Senior- ...Description Role 1: Staff Engineer – AI Workload... ...with LLM training/inference tools (PyTorch, vLLM... ...in Python; systems work in C/C++.... ...tracing tools and GPU/accelerator I/O knowledge. Open‐source contributions strongly... ...preferred Role 2: Senior Staff Engineer – Memory...Senior
The Norland Group
San Jose, CA2 days ago $184k - $287.5k
...and Deep Learning Systems. As the complexity... ...performance for emerging AI workloads. You... ...from a single GPU to supercomputer clusters... ...both training and inference pipelines.... ...smoothly transition into open-source releases, upstream... ...Science, Computer Engineering, Electrical...Senior$184k - $287.5k
...We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What... ..., and agentic optimization systems that improve GPU kernels at... ...kernel optimization: applying AI-driven analysis to diagnose... ...Active contributions to open-source LLM inference or GPU kernel...Senior$224k - $356.5k
...are now looking for a Senior System Software Engineer to work on Dynamo.... ...software engineers for its GPU-accelerated deep... ...a revolution in AI, enabling breakthroughs... ...Generative AI inference platform to make design... ...role, you will develop open source software to serve...Senior$224k - $356.5k
...unlimited potential of AI to define the next... ...era in which our GPU acts as the brains... ...of the box. The open-source community builds... ...leading open-source LLM inference frameworks —... ...Science, Computer Engineering, Electrical Engineering... ...GPU computing, ML systems, or high-...SeniorLocal area$184k - $287.5k
NVIDIA’s invention of the GPU in 1999 fueled the... ...increasingly known as “the AI computing company.” We'... ...qualifying the whole system software and firmware stack... ...higher; in Electrical Engineering or Computer Science or... ...and services. Our work opens up new universes to...SeniorFull timeNvidia
Santa Clara, CA4 days ago$119.8k - $234.7k
...and Infrastructure Engineering (SCHIE) is the team... ...Microsoft's Hardware Systems organization is developing AI-native silicon and system... ...AI training and inference capabilities. The Platform... ...:Experience with GPU, FPGA, TPU, or... ...This position will be open for a minimum of 5 days...SeniorOngoing contractWork at officeLocal areaWorldwide3 days per weekMicrosoft
Mountain View, CA2 days ago$152k - $241.5k
...innovative and highly motivated engineer with deep expertise in systems software to join our GPU Software team. In this role,... ...maintainer or contributor to large open source software projectsExperience... ...existing vacancy. NVIDIA uses AI tools in its recruiting processes...SeniorFull timeNvidia
Santa Clara, CA4 days ago- ...in Santa Clara, CA is seeking a software engineer with a strong background in parallel processing and GPU architecture to push the performance envelope at the intersection of AI, high‑performance computing, and financial systems. You will design and optimize CUDA‑based...Senior
- ...NVIDIA Corporation is seeking a Senior GPU Platforms Engineer to drive GPU/SOC software across platforms, focusing on kernel driver development,... ...optimization. You will build high‑performance observability systems and full‑stack software for SOC products while...Senior
$184k - $287.5k
...network stack for distributed inference which will be used to... ...impact on the world by applying AI inference aware technology to... ...Computer Science, Electrical Engineering, Software Engineer, or related... ...building cloud-grade networks using open-source tools and orchestration...SeniorWork experience placement$262k - $364k
...Senior Staff Software Engineer, GPU System Software Share Senior Staff Software Engineer, GPU System Software Google Sunnyvale, CA, USA X In most... ...deploy, maintain, and enhance software solutions. The AI and Infrastructure team is redefining what’s possible. We...SeniorWorldwide$152k - $241.5k
...for an outstanding Senior Compiler Engineer to help build the... ..., agentic systems, numerical correctness... ...tradeoffs across GPU-centric workloads... ...spanning models and inference, compiler... ...experience in compilers, AI systems,... ....Publications or open-source leadership in compilers...SeniorFull timeRemote workNvidia
Santa Clara, CA2 days ago- ...deeply in Generative AI — pioneering advanced... ...Principal Machine Learning Systems Engineer (P60) to lead... ...scale model training, inference pipelines, or search/retrieval... ...computing, or GPU optimization.Familiarity... ...systems.Contributions to open-source infra or ML systems frameworks...Work at officeLocal area
Atlassian
Mountain View, CA20 hours ago - ...Corporation in Santa Clara, CA is seeking a Senior Technical Marketing Engineer focused on GPUs and scale-up... ...and deployment, translating complex GPU and NVLink concepts into compelling narratives... ...for hyperscalers, OEMs, and system IT operators. This role requires deep...Senior
$164k - $313.3k
...ASML) is seeking a Senior Applied Scientist / Engineer, Training & Inference to play a critical... ...model research or systems infrastructure in isolation... ...Engineering, AI/ML, or a related field... ...across multi-node GPU environments.... ...Notice If this role is open to hiring in Colorado...SeniorTemporary workLocal areaWorldwide$234k - $286k
...next-generation AI... ...a full-stack inference platform for... ...traditional GPU model. Its decode... ...looking for a Senior Principal AI Solutions Engineer: a hands‑on technical... ...modern AI stack: open-weight models... ...‑improving systems Agentic AI... ...kits, open-source examples and...SeniorFull timeLocal areaWorldwide$193.3k - $261.5k
...Senior Software Development Engineer, AI/ML, AWS Neuron, Model Inference Job ID: 10505474 | Amazon.com Services LLC The Annapurna... .... The team collaborates with open source ecosystems to provide... ...models across the stack from system level optimizations through to...SeniorWork experience placementInternshipFlexible hours$182k - $242k
...Essential Cloud for AI™. Built for... ...You'll Do: IT Engineering at CoreWeave designs... ...and operates the systems that enable our employees... ...is hiring a Senior AI Platform Engineer... ...allowlists with data-source scoping across... ...teams that run it. Inference endpoints, agent...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursCoreWeave
Sunnyvale, CA6 days ago$102.5k - $213.4k
...organizations. Using our product-driven, AI-centric approach, we empower... ..., designers, and software engineers enable our clients to solve... ...responsibilities As a Senior Application Designer and Developer... ...Work on distributed systems problems ranging from scheduling...SeniorFull timeSummer holidayFlexible hours$248k - $396.75k
...Site Reliability Engineering (SRE) at NVIDIA... ...scale production systems with exceptional... ...across NVIDIA’s AI Platform Runtime... ...Partner with senior leaders and engineers... .../ML platforms, GPU infrastructure, inference systems,... ..., publications, open-source contributions, industry...NVIDIA Gruppe
Santa Clara, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference Systems Engineer (GPU, Open Source). Be the first to apply!
Related searches
- senior ai engineer Santa Clara, CA
- ai developer Santa Clara, CA
- ai prompt engineer Santa Clara, CA
- ai engineer Santa Clara, CA
- ai engineer remote Santa Clara, CA
- distributed systems engineer Santa Clara, CA
- digital communications systems engineer Santa Clara, CA
- space systems engineer Santa Clara, CA
- sr systems engineer Santa Clara, CA
- system engineer contract Santa Clara, CA