Senior Quantized Inference Engineer — LLM Acceleration
NVIDIA
NVIDIA in Redmond, WA is seeking a Senior Software Engineer for Quantized Inference to accelerate the development of efficient inference recipes for LLMs. You will translate recipe specifications into high-performance code, including Triton kernels and quantize/dequantize nodes. Collaborate with inference teams to optimize throughput and interactivity, build prototypes, and ensure scalable model export pipelines across Megatron-LM, ModelOpt, and vLLM. #J-18808-Ljbffr NVIDIA
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Quantized Inference Engineer — LLM Acceleration in Redmond, WA vacancy
- NVIDIA is seeking a Senior Software Engineer for Quantized Inference to accelerate the development of efficient inference recipes for LLMs. You will implement quantized and sparse recipes, work on kernel and model-level implementations, and collaborate with partner teams...Senior
- NVIDIA Gruppe is seeking a Senior Software Engineer for Quantized Inference in Redmond, Washington. You will be responsible for implementing quantized and... ...fundamentals, and have experience with ML accelerators. This role will collaborate directly with partner inference...Senior
$152k - $241.5k
We are now looking for a Senior Software Engineer for Quantized Inference! NVIDIA is seeking software engineers to accelerate the discovery and deployment of efficient inference recipes... ...in inference engines (vLLM, TRT-LLM, SGLang). The candidate will translate recipe...SeniorFull time- CoreWeave is seeking a Senior Engineer for its Benchmarking & Performance team to own kernel authoring and optimization for LLM inference. You will write and tune CUDA kernels, optimize tensor cores, and push end-to-end latency down while maintaining accuracy. You will...Senior
$184k - $287.5k
...millions globally. We seek a Senior Engineer to lead technical efforts in... ...By combining powerful local inference (Nemotron models) with strong... ...architecture.Proven understanding of LLM inference pipelines (Ollama, Llama.cpp, vLLM), GPU-accelerated computing (CUDA, TensorRT),...SeniorFull timeLocal areaShift work$184k - $287.5k
...“the AI computing company”.We're looking for a Senior Performance Compiler Engineer to join our team and work on the open-source Triton... ...agents, and other high-impact AI applications, accelerating both training and inference. You will be immersed in a diverse, supportive...SeniorFull timeRemote work$184k - $287.5k
...transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a... ...the world.We are seeking an AI Compiler Engineer with deep expertise in compiler... ...performance and efficiency, and advancing LLM-enabled workflows for compiler decisioning...SeniorFull timeRemote work$152k - $241.5k
...transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s... ...looking for a Deep Learning Compiler Engineer. NVIDIA is hiring software engineers... ...DLC has been the backbone of NVIDIA inference engine, spanning across data centers, personal...SeniorFull timeRemote work$174k - $252k
Google is seeking a Software Engineer to drive optimizations for advanced GPU technologies impacting billions of users. Candidates should have a Bachelor’s degree and significant experience in software development and GPU programming. Responsibilities include building...Senior$161.3k - $274.2k
...DescriptionIt all started when engineer Fred Luddy wrote code that... ...and workloads to the cloud, accelerating our business so that we are the... ...Designer)Experience with AI/LLM concepts, prompt engineering,... ...EngineeringExperience level: Mid-Senior LevelIndustry: Information...SeniorWork at officeImmediate startRemote workFlexible hours- ...how you solve problems and accelerate your impact. We look for low... ...of how work gets done.Senior Software Engineer — Cortex TrainingThe Snowflake... ...Snowflake. Cortex Training is our LLM post-training platform: it... ..., multi-node training and inference, fault tolerance, and...Senior
$184k - $287.5k
NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of... ...worldWe are looking for an experienced Compiler Optimization Engineer for an exciting role in our Compute Compiler Team. We deliver...SeniorFull time$119.8k - $234.7k
...Hardware, and Infrastructure Engineering (SCHIE) is the team behind... ...Engineering (PSE) team is seeking a Senior AI Network Systems Engineer... ...large-scale AI training and inference clusters. Collaborate with... ...validating networking for accelerator based systems.5+ years of...SeniorOngoing contractWork at officeLocal areaWorldwide3 days per week$152k - $241.5k
NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of... ...world.We are seeking a highly skilled and experienced HPC Cluster Engineer to design, deploy, and operate GPU Compute Clusters for EDA (Electronic...SeniorFull time$200k - $270k
...is core to how you solve problems and accelerate your impact. We look for low-ego... ...companies unlock the power of AI. As a Senior Forward Deployed Engineer, Applied AI on our Cortex AI team, you... ...metrics and evaluation frameworks for LLM or agent systems, and using evals to...Senior$165k - $242k
...strategies. Mentor IC1/IC2 engineers; review cross-team designs and... ...utilization, and leveraging custom accelerators for high-efficiency workloads... ...). Practical knowledge of inference internals: batching, caching,... ...(vLLM, Triton, TensorRT‑LLM, Ray Serve, TorchServe). Experience...SeniorPermanent employmentTemporary workWork at officeRemote workFlexible hoursShift work$119.8k - $234.7k
...correction to comprehensive integration with Azure. As a Senior Quantum Engineer you will design and test the readout system for topological... ...work in an “AI-first” environment using modern AI tools to accelerate discovery through hardware development. Additional or...SeniorOngoing contractPermanent employmentLocal area3 days per week$119.8k - $234.7k
...more information about our team, visit . We are seeking a Senior Quantum Engineer - Cryo-CMOS Analog Circuit Design to design and develop... ...work in an “AI-first” environment using modern AI tools to accelerate discovery through hardware development. Preferred Qualifications...SeniorOngoing contractPermanent employmentLocal area3 days per week$161k - $239k
...3 years of experience in AI/ML related engineering, developing, deploying, managing, and maintaining... .... Knowledge of Kubernetes and AI inference workloads. About the job Google's... ...external industry leads. Google Cloud accelerates every organization’s ability to digitally...SeniorFull time$142.8k - $274.8k
...topological quantum computing! We're looking for a Senior orPrincipal Process Design Kit (PDK) Engineer; in this pivotal role you will help develop and mature... ...an “AI-first” environment using modern AI tools to accelerate discovery through hardware development. Additional...SeniorOngoing contractPermanent employmentLocal area3 days per week$152k - $241.5k
NVIDIA is building advanced compiler technologies to accelerate AI workloads, and we are looking for an engineer focused on performance validation, analysis, and tracking. In this role, you will work at the intersection of deep learning compilers, GPU systems, and automation...SeniorFull timeRemote work$184k - $287.5k
NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of... ...leading simulation & emulation technology.Mentor architects and engineering teams to grow them into future leaders.Make key technical...SeniorFull timeRemote workShift work$139.8k - $171.75k
...experiences. We are seeking a highly motivated and skilled Senior Electrical Engineer to join our Hardware Engineering team and contribute to... ...embrace technology, including AI, to enhance productivity and accelerate innovation in the work we do for our members. However, in...SeniorLocal areaOverseas$152k - $241.5k
We are looking for a Deep Learning and Computer Vision engineer for our Autonomous Vehicles team. The role involves applying state-of... ...collecting training datasets.Building training pipelines and real-time inference run-times (PyTorch, TensorFlow, TensorRT, Python, C++).What we...SeniorFull timeNight shift$119.8k - $234.7k
...the heart of it. We’re on the lookout for a detail-oriented Senior Language Engineer to help build the next wave of capabilities of our personal... ...iteratively improved products. 1+ years of experience in building LLM applications with familiarity in agent and orchestration...SeniorOngoing contractWork at officeLocal areaImmediate start$168.1k - $227.4k
...proven through rigorous automated testing.We are hiring a Senior Software Development Engineer to lead the design and development of automation that... ...solutions that reduce manual testing effort and accelerate release cycles.• Define and implement system architectures...SeniorPermanent employmentInternshipLocal areaImmediate startFlexible hours$145.3k - $232.7k
..., and data. This role combines hands-on engineering, automation-first security design, and technical... ...to minimize manual intervention and accelerate incident response workflows. GenAI &... ...safely. Evaluate and adopt emerging LLM, agent orchestration, and AI governance...SeniorPart timeWork experience placementWork at officeLocal areaVisa
Bellevue, WA19 hours ago$119.8k - $234.7k
...applying AI to solve real-world problems?We are looking for a Senior Software Engineer (Technical Lead) to design and deliver cloud-native services... ...and implement AI-powered capabilities (e.g., copilots, LLM integrations, and agent-based workflows) with appropriate evaluation...SeniorOngoing contractWork at officeLocal area$159.2k - $215.3k
...granted asylum. We are seeking a highly skilled and motivated Senior Reliability Engineer to join the Hardware Reliability Engineering team within... ..., including temperature cycling, vibration, highly accelerated limit testing (HALT), and highly-accelerated stress screening...SeniorPermanent employmentFlexible hours$130.4k - $195.6k
...adapting PolySpatial to stream Unity content into other game engines and 3D environments — in-process, cross-process, and... ....Experience with MCP-style tool interfaces, LLM agents, multimodal models, inference pipelines, embeddings, vector search, or AI systems that...SeniorFull timeWork at officeRemote workWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Quantized Inference Engineer — LLM Acceleration. Be the first to apply!
Related searches
- senior safety specialist Redmond, WA
- senior technology project manager Redmond, WA
- remote senior business analyst Redmond, WA
- senior manager clinical operations Redmond, WA
- senior researcher Redmond, WA
- senior leadership Redmond, WA
- sr. process development engineer Redmond, WA
- senior grant accountant Redmond, WA
- senior storage engineer Redmond, WA
- senior electronic design engineer Redmond, WA