Senior System Software Engineer, LLM
$156k - $287.5kNVIDIA
NVIDIA's technology is at the heart of the AI revolution, touching people across the planet by powering everything from self-driving cars, robotics, and intelligent assistants. Come join the team and see how you can make a lasting impact on the world! We are looking for someone who's curious, tenacious, and passionate to join our applied research team. We develop tools for powerful, flexible and trustworthy conversational agents. Be a part of the team that builds NeMo Guardrails, an open-source toolkit for easily adding programmable guardrails to large language model-based conversational systems. We build innovative projects connecting dialogue systems, AI safety, and cybersecurity, all working with the latest powerful large language models. Join us to influence and build the next generation of Conversational AI! What you'll be doing: Work closely with senior engineers to deliver, optimize, maintain, debug, unit test and document next-generation dialogue and security toolkits for large language models Tackle difficult and ambitious problems by contributing to the core development of NeMo Guardrails and Colang Deliver rapid iterations of software based on user feedback and metrics Collaborate with your peers and other teams to craft, develop, test, and maintain integrated applications and features Actively contribute to the adoption of frameworks, standards, and new technologies What we need to see: BS or MS (or equivalent experience) in Computer Science, Electrical Engineering, or a related field 5+ years of software development experience Strong software engineering and Python programming skills Knowledge of RESTful APIs Proficient in agile methodology Experience in software shipping cycles (dev, deploy, release, CI) and open-source software development You are highly motivated, passionate and curious about new technologies Ability to work optimally with multi-functional teams, principals and architects. Coordinates across organizational boundaries and geographies. Ways to stand out from the crowd: Research or product development experience with task-oriented dialogue systems Experience with programming language design and development Systems software engineering knowledge and expertise in optimizing software for computational performance Experience with Cloud Service Providers such as AWS, Azure, GCP, and OCI Contributions to open-source software The base salary range is 156,000 USD - 287,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. #J-18808-Ljbffr NVIDIA
$184k - $287.5k
...the next generation of outstanding AI systems to transform GPU software development. Our team leads the... ...and continuous improvementBuild robust LLM-powered pipelines for code generation... ...funnelWork closely with GPU SW kernel engineers to pinpoint high-impact automation opportunities...SeniorFull time$224k - $356.5k
We are now looking for a Senior System Software Engineer to work on Dynamo. NVIDIA is hiring software engineers for its GPU-accelerated deep learning... ...for Dynamo-supported inference engines (vLLM, SGLang, TRT-LLM) and expand these capabilities to support agentic...SeniorFull time$184k - $287.5k
...assistants and information retrieval. NVIDIA is looking for a System Software Engineer - Agentic Retrieval to develop pipelines for indexing and... ...with the world's most challenging problems in Generative AI, LLM, VLLM, and Agentic Retrieval spaces using our innovative hardware...SeniorFlexible hours- ...Platform replaces fragmented, human-limited workflows with agentic AI systems that continuously contextualize, assess, reason, and execute... ...the design and deployment of cutting-edge Generative AI and LLM-powered systems for real-world, high-impact applications. #J-188...Senior
$152k - $241.5k
...We're hiring a Deep Learning Engineer with strong experience in generative... ...computer vision, and agentic systems. If you've spent more time... ...fast and iterate faster Leverage LLM/VLM and agents in the data... ...in Python and C/C++. Excellent software engineering fundamentals. Ability...SeniorInternship- Develop and productize agentic AI systems to automate GPU software development tasks such as bug triage and code generation... ...equivalent with over 8 years of software engineering experience, including at least 2 years in production LLM or agentic AI. Must be proficient in...Senior
$224k - $356.5k
...We are looking for a Senior System Software Engineer to work on Dynamo-Triton Inference Server. NVIDIA is hiring software engineers for its GPU-accelerated... ...parity and effectively serve both Large Language Model (LLM) and non-LLM workloads. Be an active member of the open...Senior$152k - $241.5k
...a motivated, product-minded AI/ML Engineer with domain expertise in AI platform... ...AI/DL frameworks and inferencing software such as SGLang, vLLM, TensorRT-LLM, or Dynamo. Knowledge of CPU... ...experience in building distributed systems. NVIDIA offers highly competitive...SeniorWork experience placementFlexible hours$184k - $287.5k
We are now looking for a Senior System Software Engineer to work in our Tegra system software group. The best candidates will have excellent C/C++, a thorough understanding of operating systems and kernel programming, a good understanding of computer architecture. You will...SeniorFull time$152k - $241.5k
As a Vulkan Performance driver engineer, you will have a hand in everything from the game engine down to bare metal! You will be part... ...experience5+ years of experience (or equivalent) in graphics software, system programming, or related field.An understanding of graphics...SeniorFull time$184k - $287.5k
...see how you can make a lasting impact on the world.NVIDIA is searching for a highly motivated, technical engineer to join the Tegra system-on-chip (SoC) software organization. You will work on key aspects of our ARM SW ecosystem and system software architecture. With...SeniorFull timeRemote work$152k - $241.5k
NVIDIA Solutions Engineering team is searching for engineers to help develop and bring NVIDIA’s autonomous vehicle platform to the world... ...people can do their best work. We are looking for a System Software Engineer with expertise in embedded systems, good grasp of operating...SeniorFull time$184k - $287.5k
...responsible for building a scalable and modular software stack that powers advanced driver-assistance systems across a diverse range of product lines and... .... We are looking for a highly motivated Senior Software Systems Engineer with a strong foundation in software...SeniorFull time$152k - $241.5k
...enthusiastic and technologically savvy engineers to join the Tegra Core Firmware team. Here... ..., a thorough understanding of operating systems and kernel programming, a good... ...functionality and architecture.We take pride in our software family of engineers, so collaboration is...SeniorFull time$184k - $287.5k
...responsibilities and opportunities! We work with sister software teams on developing features for upcoming... ...responsibilities evolve over time, resulting in a rich engineering experience and career. As a Compute Systems Software Engineer at NVIDIA, you will work on the kernel...SeniorFull timeWorldwide$184k - $287.5k
...our innovations are revolutionizing self-driving cars, machine learning, supercomputing, gaming, and visualization. As a Senior System Software Engineer on the NvSci team, you will play an integral role in crafting NVIDIA's leadership in AI.What you'll be doing:Build and...SeniorFull timeRemote work$184k - $287.5k
...to do their best work. Come join the team and see how you can make a lasting impact on the world.NVIDIA is seeking a Sr. Systems Software Engineer for the Apache Spark Acceleration group. Over the past five years GPU accelerated data processing has moved from proof of...SeniorFull time$152k - $241.5k
...in a diverse, supportive environment where everyone is inspired to do their best work.We are searching for outstanding senior system software engineer to join the NVIDIA's GPU Diagnostics SW team. Our charter is to develop the most demanding applications a GPU or high-performance...SeniorFull time$152k - $241.5k
We are hiring senior engineers to work on the CUDA driver, a core component of our platform for... ...unified programming model across a range of system configurations and hardware... .... This role incorporates strong system software programming skills, a detailed understanding...SeniorFull time$184k - $287.5k
...and database acceleration. We're looking for an outstanding software engineer to apply their skills in the development of our unstructured... ...used directly or to accelerate other libraries and database systems. In this role, you will research, develop, benchmark, and explore...SeniorFull time$184k - $287.5k
We are looking for a talented Senior System Software Engineer to help build NVIDIA Halos, our full-stack safety platform for physical AI: autonomous vehicles, humanoids, industrial robots, and intelligent machines that sense, decide, and act in the real world. This role...SeniorFull time$152k - $241.5k
Join NVIDIA's Solution Engineering team that is changing the future of driving. Our goal is... ...diversity. You will help craft the application software architecture by working closely with... ...to tease through the complexity of the system to find effective solutions.NVIDIA is...SeniorFull time$184k - $287.5k
...streaming foundation into the automotive domain, where the bar isn't just performance — it's safety as well.We are seeking a Senior Systems Software Engineer with deep knowledge of RTOS and software safety standards to help bring GFN's real-time streaming technology to...SeniorFull time$152k - $241.5k
...are looking for a motivated Performance engineer to influence the roadmap of our communication... ...clustersGood understanding of computer system architecture, HW-SW interactions and operating systems principles (aka systems software fundamentals)Implement micro-benchmarks...SeniorFull time$152k - $241.5k
...how you can make a lasting impact on the world.NVIDIA is searching for a creative and highly motivated engineer with expertise in boot software to join the SOC System Software organization. This position offers the opportunity to have real impact in a dynamic, technology...SeniorFull time$184k - $287.5k
...best work. Come join the team and see how you can make a lasting impact on the world.We are looking for a dedicated engineer for the Senior Systems Software Engineer role, focusing on GPU Performance at Scale. At NVIDIA, this role is uniquely positioned to drive...SeniorFull timeRemote work$184k - $287.5k
NVIDIA is seeking a Senior System SW Engineer with expertise in systems software, GPU drivers, embedded software, and platform security. You will provide technical leadership for security and architecture initiatives across production GPU kernel drivers, embedded software...SeniorFull time$184k - $287.5k
...is inspired to do their best work. The video software team is seeking someone highly motivated and passionate about system software development. Come join our team and... ....What we need to see:Bachelors in Electrical Engineering or Computer Science (or equivalent experience...SeniorFull timeWork experience placement$184k - $287.5k
NVIDIA is looking for a hardworking Sr. Systems Software Engineer to work on platform software based on open-source container runtimes and Kubernetes technologies. We expect you to have strong programming skills, a deep understanding of designing and building software,...SeniorFull timeWork experience placementRemote work$152k - $241.5k
...world working for us. If you're passionate about building reliable systems software for cloud-scale GPU infrastructure, we encourage you to contribute to our team. We are looking for a Senior Software Engineer to join our DGX Cloud / Fleet Intelligence team and build agent...SeniorFull timeLocal areaRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior System Software Engineer, LLM. Be the first to apply!
- IT system engineer Santa Clara, CA
- systems software developer Santa Clara, CA
- system programmer Santa Clara, CA
- senior living Santa Clara, CA
- senior associate vice president Santa Clara, CA
- senior app developer Santa Clara, CA
- senior manufacturing engineer Santa Clara, CA
- senior ml engineer Santa Clara, CA
- senior executive director Santa Clara, CA
- senior application support engineer Santa Clara, CA



