Compiler Engineer - AI Inference
$152k - $241.5kNVIDIA Gruppe
NVIDIA's invention of the GPU 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self‑driving cars that can perceive and understand the world. Today, we are increasingly known as “the AI computing company”. NVIDIA is seeking top‑tier AI Compiler Engineers to drive innovation within our world‑class compiler organization. In this role, you will push the boundaries of what is possible in AI performance and help build the technology that powers the next generation of computing. Join us and make a tangible impact on a global scale. What you’ll be doing: Drive technical innovation: Participating in hands‑on development focusing on kernel generation and computational graph optimizations for next‑generation NVIDIA GPUs. Advance the state‑of‑the‑art: Solve complex compilation problems for AI workloads (both inference and training) and successfully transition these breakthroughs into enterprise and consumer products. Collaborate on hardware/software co‑design: Partner with leading experts across our software, hardware, and research divisions to architect and co‑design future silicon. Scale AI to the datacenter: Participating in the advancement and optimization of datacenter‑scale AI workload deployments. What we need to see: BS or MS in Computer Science, Computer Engineering, or a related field (or equivalent experience). A PhD is strongly preferred. Compiler Experience: 3+ years of relevant industry experience specializing in compiler optimizations, synthesis, and placement. MLIR Knowledge: Demonstrated, hands‑on experience working with MLIR. Programming Excellence: Exceptional C/C++ and Python programming and software design skills, including rigorous debugging, performance analysis, and test design. Team Dynamics: Strong communication and interpersonal skills, with the ability to collaborate effectively in a dynamic, fast‑paced, and product‑oriented environment. Ways to stand out from the crowd: Hardware Implementation: Hands‑on experience implementing complex AI workloads on CPU, GPU, and/or custom AI accelerator architectures. LLM Knowledge: Deep understanding of Large Language Model (LLM) inference and its profound implications on computer architecture. Architecture & Design: Demonstrated understanding in the designing and architecting of comprehensive compiler frameworks from the ground up. With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward‑thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you’re a creative and autonomous engineer with a real passion for technology, we want to hear from you. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is $152,000 USD - $241,500 USD. You will also be eligible for equity and benefits. Applications for this job will be accepted at least until April 28, 2026. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. #J-18808-Ljbffr NVIDIA Gruppe
$184k - $287.5k
...We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency... ...inference stacks, optimize GPU kernels and compilers, drive industry benchmarks, and scale workloads across...Suggested$152k - $287.5k
NVIDIA Gruppe is seeking a Senior Machine Learning Applications and Compiler Engineer in Santa Clara, California. This role involves developing algorithms for their LPX inference and compiler stack, optimizing the performance of neural network workloads on NVIDIA platforms...Suggested$152k - $241.5k
NVIDIA Gruppe is seeking an AI & Deep Learning Compiler Engineer for its Deep Learning & AI Compiler team in Santa Clara, California. This role involves analyzing and optimizing deep learning networks, as well as developing compiler algorithms to enhance performance on...Suggested- NVIDIA Gruppe in Santa Clara, California is seeking AI Compiler Engineers to drive technological innovation within their compiler organization. The role involves working on kernel generation and optimization for next-generation NVIDIA GPUs and solving complex compilation...Suggested
$152k - $241.5k
Overview AI & Deep Learning Compiler Engineer for NVIDIA’s Deep Learning & AI Compiler (DLC) team. What you’ll be doing Analyze deep learning networks and develop compiler optimization algorithms. Collaborate with deep learning software framework teams and GPU architecture...Suggested$184k - $287.5k
NVIDIA Gruppe is seeking talented AI systems engineers to advance innovative technologies in AI inference systems software. This role involves developing cutting-edge libraries, code generators, and kernel technologies for NVIDIA's architecture, emphasizing high-impact...$152k - $241.5k
## Senior Software Engineer, Deep Learning Inference - TensorRTApplylocations: US, CA, Santa Claratime type:... ...profiling, and optimizations.* Background in compiler development* Experience in working... ...for an existing vacancy.NVIDIA uses AI tools in its recruiting processes....- ...generation computing experiences—from AI and data centers, to PCs,... ...and SOTA LLM and Multimodal inference at scale across multi-GPU and... .... THE PERSON: Skilled engineer with strong technical and analyticalexpertisein... ...with GPU Library and Compiler Teams: Work closely with...
- Cerebras Systems, Inc. in Sunnyvale, California is seeking Compiler Engineers for their innovative Tungsten programming language. This role involves designing efficient compilers for wafer-scale AI hardware, collaborating with various technical teams to shape the future...
- Intel in Santa Clara, California is seeking a talented individual to optimize inference engines for local environments, impacting the future of AI. Applicants should have a strong background in C++ and software development, with experience in profiling performance issues...Local area
- A pioneering AI technology company in Santa Clara is seeking a Graph Optimization Compiler Engineer to enhance their AI compiler stack. This role focuses on developing graph-level optimizations to deliver significant performance improvements. The ideal candidate should...
- Lemurian Labs in Santa Clara is seeking a Compiler Code Generation Engineer to design the core code generation capabilities of our AI compiler. This role involves translating high-level ML computations into optimized machine code across various hardware platforms. Ideal...
$165k - $242k
Dormont Manufacturing Co is seeking a Senior Engineer to lead designs and improve engineering standards. The role focuses on evolving our Kubernetes-native inference platform and ensuring reliability across multiple services. Qualified candidates should have 5-8 years...$184k - $356.5k
NVIDIA Gruppe is looking for skilled software engineers to develop AI inference systems that operate with high efficiency. The role involves architecting high-performance inference frameworks and optimizing GPU processes. Ideal candidates should have extensive programming...$152k - $241.5k
NVIDIA's GPUs are at the core of modern AI infrastructure, from training large-scale models to running inference in production. That position depends on software as much as hardware, and compiler engineering is a big part of what makes it work. What You'll Be Doing Design...$152k - $241.5k
...optimize and benchmark GenAI inference on NVIDIA's latest accelerators... ...of GPU performance engineering and public accountability. What... ...workflows, and other emerging AI use cases. Collaborate with framework... ...architecture, kernel, and compiler teams to shape GPU roadmaps based...$184k - $287.5k
NVIDIA Gruppe in Santa Clara is seeking an AI Systems Engineer to innovate and develop cutting-edge technologies in the AI inference software stack. Candidates should hold a... ...role involves building efficient kernels and compilers for AI workloads while actively...$184k - $287.5k
...hardware performance for emerging AI workloads. You will be a... ...bottlenecks in both training and inference pipelines. Collaborate... ...and SW architects, kernel and compiler authors and CUDA driver experts... ...in Computer Science, Computer Engineering, Electrical Engineering, or...$152k - $241.5k
...Senior Machine Learning Applications and Compiler Engineer! NVIDIA is seeking engineers to develop... ...and optimizations for our LPX inference and compiler stack. You will work at the... ...or similar. Experience with large-scale AI distributed inference or training systems...- ScOp Venture Capital is looking for an ML Systems Engineer to optimize LLM inference systems crucial for their AI platform. The role focuses on enhancing performance and efficiency via low-level systems optimization, directly impacting industry leader processes in semiconductor...
$124k - $195.5k
...model focused on visual and AI computing. For two decades, NVIDIA... ...an AI Developer Technology Engineer to push the limits of... ...with NVIDIA research, hardware, compiler, and tools teams. What we need... ...related field. Experience with inference optimization techniques and deploying...Internship$262k - $365k
Senior Engineering Manager AI Inference Platform, Distributed Cloud Location: Sunnyvale, CA, USA Pay US: $262,000 - $365,000 (USD) + 25% bonus target... ...serving, continuous batching, or specialized compiler technologies (e.g., XLA). 4+ years of experience utilizing...$132k - $330k
Software Engineer, AI Inference Codesign The AI inference co-design team's goal is to take research models and make them run efficiently on our... ...This unique role lies at the intersection of AI research, compiler development, kernel optimization, math and HW design. You...Hourly payFull timeTemporary workFlexible hours- A leading technology company is seeking a skilled engineer to optimize deep learning frameworks and enhance GPU kernel performance. The ideal... ...dynamic work environment with a focus on innovative solutions and advancing AI technologies. #J-18808-Ljbffr Advanced Micro Devices
$135k
United States Digital Space LLC in Palo Alto seeks an Application Software Engineer to develop high-performance AI inference systems. This role emphasizes the design and optimization of large-scale systems used for mission-critical applications. The ideal candidate possesses...Remote work- About the Role We are seeking a Senior Inference Engineer to accelerate the performance of Pika's AI-driven products. In this highly technical role, you will operate... ..., attention acceleration, and deep learning compiler stacks. GPU & Parallelism : Deep knowledge of GPU...Work at office3 days per week
- Latent AI is seeking to enhance the MLIR ecosystem. The ideal candidate will help extend high-level dialects and design a new hardware... ...Successful applicants should have over 3 years of experience in compiler development, proficiency in modern C++ and Python, and hands-on...
- Pika is seeking an experienced Inference Engineer to enhance the performance of its AI-driven products in Palo Alto, CA. The role encompasses optimizing inference pipelines, applying advanced acceleration techniques, and collaborating on AI model deployment. The ideal candidate...
- Pika is looking for a Senior Inference Engineer in Palo Alto to enhance the performance of AI-driven products. This pivotal role involves designing and optimizing inference pipelines, applying advanced techniques to improve model speed and efficiency. The ideal candidate...
- A cutting-edge AI company in California is looking for a Member of Technical Staff for Kernel/Compiler/Communication. This critical role requires strong expertise in CUDA and... ...5+ years of experience in performance engineering. The ideal candidate will design high-performance...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Compiler Engineer - AI Inference. Be the first to apply!
