Compiler Engineer - AI Inference
$152k - $241.5kNVIDIA
NVIDIA's invention of the GPU 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, we are increasingly known as “the AI computing company”. NVIDIA is seeking top-tier AI Compiler Engineers to drive innovation within our world-class compiler organization. In this role, you will push the boundaries of what is possible in AI performance and help build the technology that powers the next generation of computing. Join us and make a tangible impact on a global scale. What you’ll be doing: Drive technical innovation: Participating in hands-on development focusing on kernel generation and computational graph optimizations for next-generation NVIDIA GPUs. Advance the state-of-the-art: Solve complex compilation problems for AI workloads (both inference and training) and successfully transition these breakthroughs into enterprise and consumer products. Collaborate on hardware/software co-design: Partner with leading experts across our software, hardware, and research divisions to architect and co-design future silicon. Scale AI to the datacenter: Participating in the advancement and optimization of datacenter-scale AI workload deployments. What we need to see: BS or MS in Computer Science, Computer Engineering, or a related field (or equivalent experience). A PhD is strongly preferred. Compiler Experience: 3+ years of relevant industry experience specializing in compiler optimizations, synthesis, and placement. MLIR Knowledge: Demonstrated, hands‑on experience working with MLIR. Programming Excellence: Exceptional C/C++ and Python programming and software design skills, including rigorous debugging, performance analysis, and test design. Team Dynamics: Strong communication and interpersonal skills, with the ability to collaborate effectively in a dynamic, fast‑paced, and product‑oriented environment. Ways to stand out from the crowd: Hardware Implementation: Hands‑on experience implementing complex AI workloads on CPU, GPU, and/or custom AI accelerator architectures. LLM Knowledge: Deep understanding of Large Language Model (LLM) inference and its profound implications on computer architecture. Architecture & Design: Demonstrated understanding in the designing and architecting of comprehensive compiler frameworks from the ground up. With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward‑thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you’re a creative and autonomous engineer with a real passion for technology, we want to hear from you. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD. You will also be eligible for equity and benefits. Applications for this job will be accepted at least until April 28, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. #J-18808-Ljbffr NVIDIA
$184k - $287.5k
...We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency... ...inference stacks, optimize GPU kernels and compilers, drive industry benchmarks, and scale workloads across...Suggested- ...generation computing experiences—from AI and data centers, to PCs,... ...As a senior member of the LLM inference framework team, you will be... ...the intersection of inference engines, distributed systems, and GPU... ...and collaborating with kernel, compiler, and networking teams to close...Suggested
$152k - $287.5k
NVIDIA Gruppe is seeking a Senior Machine Learning Applications and Compiler Engineer in Santa Clara, California. This role involves developing algorithms for their LPX inference and compiler stack, optimizing the performance of neural network workloads on NVIDIA platforms...Suggested$152k - $241.5k
NVIDIA Gruppe is seeking an AI & Deep Learning Compiler Engineer for its Deep Learning & AI Compiler team in Santa Clara, California. This role involves analyzing and optimizing deep learning networks, as well as developing compiler algorithms to enhance performance on...Suggested$152k - $241.5k
NVIDIA is seeking an AI Compiler Engineer in Santa Clara, CA, to drive innovation in compiler technology and improve AI performance. This role focuses on enhancements for next-generation GPUs, solving AI workload compilation challenges, and collaborating on hardware/software...Suggested- NVIDIA Gruppe in Santa Clara, California is seeking AI Compiler Engineers to drive technological innovation within their compiler organization. The role involves working on kernel generation and optimization for next-generation NVIDIA GPUs and solving complex compilation...
$152k - $241.5k
Overview AI & Deep Learning Compiler Engineer for NVIDIA’s Deep Learning & AI Compiler (DLC) team. What you’ll be doing Analyze deep learning networks and develop compiler optimization algorithms. Collaborate with deep learning software framework teams and GPU architecture...$184k - $287.5k
NVIDIA Gruppe is seeking talented AI systems engineers to advance innovative technologies in AI inference systems software. This role involves developing cutting-edge libraries, code generators, and kernel technologies for NVIDIA's architecture, emphasizing high-impact...$152k - $241.5k
NVIDIA AI is looking for a skilled AI Research Engineer / Applied Scientist to join their team in Santa Clara, California. This full-time role focuses on building innovative AI compiler solutions and optimizing GPU code generation. Ideal candidates should have a strong...Full time- ...generation computing experiences—from AI and data centers, to PCs,... ...and SOTA LLM and Multimodal inference at scale across multi-GPU and... .... THE PERSON: Skilled engineer with strong technical and analyticalexpertisein... ...with GPU Library and Compiler Teams: Work closely with...
- Lemurian Labs in Santa Clara is seeking a Compiler Code Generation Engineer to design the core code generation capabilities of our AI compiler. This role involves translating high-level ML computations into optimized machine code across various hardware platforms. Ideal...
- Intel Corporation is seeking a Senior Compiler Engineer to develop and optimize compiler software for next-generation GPU architectures. The role... ...on cutting-edge compiler technologies that enhance AI and high-performance computing performance. The ideal candidate...
- A pioneering AI technology company in Santa Clara is seeking a Graph Optimization Compiler Engineer to enhance their AI compiler stack. This role focuses on developing graph-level optimizations to deliver significant performance improvements. The ideal candidate should...
- Lemurian Labs in Santa Clara is looking for a Graph Optimization Compiler Engineer to optimize the middle tier of our AI compiler stack. You will work on transformations crucial for performance. The ideal candidate has extensive experience in compiler development, particularly...
$184k - $356.5k
NVIDIA Gruppe is looking for skilled software engineers to develop AI inference systems that operate with high efficiency. The role involves architecting high-performance inference frameworks and optimizing GPU processes. Ideal candidates should have extensive programming...$152k - $241.5k
Overview NVIDIA's GPUs are at the core of modern AI infrastructure, from training large‑scale models to running inference in production. That position depends on software as much as hardware, and compiler engineering is a big part of what makes it work. The position is...Full time$152k - $241.5k
...optimize and benchmark GenAI inference on NVIDIA's latest accelerators... ...of GPU performance engineering and public accountability. What... ...workflows, and other emerging AI use cases. Collaborate with framework... ...architecture, kernel, and compiler teams to shape GPU roadmaps based...$184k - $287.5k
NVIDIA Gruppe in Santa Clara is seeking an AI Systems Engineer to innovate and develop cutting-edge technologies in the AI inference software stack. Candidates should hold a... ...role involves building efficient kernels and compilers for AI workloads while actively...$152k - $241.5k
NVIDIA's GPUs are at the core of modern AI infrastructure, from training large-scale models to running inference in production. That position depends on software as much as hardware, and compiler engineering is a big part of what makes it work. We are looking for outstanding...$152k - $241.5k
...Senior Machine Learning Applications and Compiler Engineer! NVIDIA is seeking engineers to develop... ...and optimizations for our LPX inference and compiler stack. You will work at the... ...or similar. Experience with large-scale AI distributed inference or training systems...$124k - $195.5k
...model focused on visual and AI computing. For two decades, NVIDIA... ...an AI Developer Technology Engineer to push the limits of... ...with NVIDIA research, hardware, compiler, and tools teams. What we need... ...related field. Experience with inference optimization techniques and deploying...Internship- A leading technology company is seeking a skilled engineer to optimize deep learning frameworks and enhance GPU kernel performance. The ideal... ...dynamic work environment with a focus on innovative solutions and advancing AI technologies. #J-18808-Ljbffr Advanced Micro Devices
$152k - $241.5k
NVIDIA is the platform upon which every new AI‑powered application is built. We are seeking a Senior Software Engineer - AI Inference to advance open‑source LLM serving by contributing directly to upstream inference engines like vLLM and SGLang-ensuring they run best‑in...$152k - $241.5k
NVIDIA Gruppe is seeking an AI Research Engineer / Applied Scientist in Santa Clara, California. This role involves developing innovative AI compiler solutions and requires a strong background in machine learning and software engineering. The successful candidate will have...$152k - $241.5k
Senior Software Engineer - Deep Learning Inference What you’ll be doing: Craft and develop robust inferencing software that can be scaled to multiple... ..., profiling, and optimizations. Background in compiler development Experience in working with TensorRT, PyTorch...$80 - $95 per hour
A major technology staffing firm is searching for a Compiler Engineer in Mountain View, California. The successful candidate will have expertise in MLIR and LLVM, developing compiler components for AI/ML workloads. Responsibilities include collaborating with hardware teams...$152k - $241.5k
...deep learning ignited modern AI — the next era of computing —... ...looking for versatile software engineers for our XLA team. NVIDIA is... ...Responsibilities In this role, develop compiler optimization algorithms for... ...workloads. You will optimize inference and training performance for...$152k - $241.5k
## Senior Compiler Engineer - DLApplylocations: US, CA, Santa Clara: US, TX, Austin: US, TX, Remote... ...into the unlimited potential of AI to define the next era of computing. An... ...Our DLC has been the backbone of NVIDIA inference engine, spanning across data centers, personal...Remote work$320k
...strategy and lead execution for agentic AI systems for the CUDA ecosystem,... ...decisions—from hardware through compilers/toolchains, kernels/libraries,... ..., distributed training, and inference/serving—and with model and research/engineering teams. Scale impact through leadership...- Latent AI is seeking to enhance the MLIR ecosystem. The ideal candidate will help extend high-level dialects and design a new hardware... ...Successful applicants should have over 3 years of experience in compiler development, proficiency in modern C++ and Python, and hands-on...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Compiler Engineer - AI Inference. Be the first to apply!
