Senior Software Engineer - Quantized Inference & ML Precision
NVIDIA
NVIDIA Corporation in Santa Clara, CA seeks a Senior Software Engineer specializing in Quantized Inference to speed up LLM deployment. You will implement quantized and sparse recipes in inference engines, optimize export pipelines, and build benchmarks for throughput and interactivity across Megatron-LM, vLLM, and related tools. Key work includes writing Triton kernels, integrating quantize/dequantize paths, and collaborating with cross-team inference groups to push performance. #J-18808-Ljbffr NVIDIA
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer - Quantized Inference & ML Precision in Santa Clara, CA vacancy
$152k - $241.5k
We are now looking for a Senior Software Engineer for Quantized Inference! NVIDIA is seeking software engineers to accelerate... ...are transformed into low-precision or sparsified variants — unlocking... ...AI-assisted toolingExperience with ML accelerators with a basic understanding...SeniorFull time$152k - $241.5k
We are now looking for a Senior Software Engineer for Deep Learning Inference! Would you like to make a big impact in Deep Learning by helping build a state-of... ...TensorRT, PyTorch, TensorFlow, ONNX Runtime or other ML frameworks.NVIDIA is widely considered to be one of the...SeniorFull time$193.3k - $261.5k
...builds Amazon Neuron, the software development kit used to... ...and Trainium ML accelerators. This comprehensive... ...unparalleled ML inference and training performance... ...software boundary, our engineers build systematic infrastructure... ...and mentorship. Our senior members enjoy one-on-...SeniorWork experience placementInternshipLocal areaFlexible hours$184k - $287.5k
We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency.... ...research that pushes the pareto frontier for the field of ML Systems; survey recent publications and find a way to...SeniorFull time- NVIDIA is seeking a Senior Software Engineer for Deep Learning Inference to help build a state-of-the-art inference framework on NVIDIA GPUs, accelerating large... ...performance, and collaborate with GPU architects and ML researchers to push TensorRT forward. #J-18808-...Senior
$152k - $241.5k
...most challenging problems. We're seeking talented and motivated engineers to join our TensorRT team in developing the industry-leading deep learning inference software for NVIDIA AI accelerators. As a Senior Software Engineer in the TensorRT team, you will be responsible...SeniorFull time$193.3k - $261.5k
We develop AWS Neuron, the complete software stack for Trainium, Amazon's custom cloud-scale machine learning accelerators. Join... ...on the Trainium hardware.As a Sr. Software Development Engineer on the Inference Model Enablement team, you will onboard and optimize state...SeniorInternshipLocal areaFlexible hours$213k - $263k
...across 15+ U.S. states. The ML Ops team, part of Waymo ML Platform... .... We’re looking for a software engineer to join the team to build and... ...to the Head of ML Platform- Senior Staff Software Engineer.... ...will: Develop Waymo's inference platform to make it scalable,...SeniorFull timeRemote workWaymo
Mountain View, CA3 days ago$224k - $356.5k
...team is building the software stack that makes large... ...leading open-source LLM inference frameworks — identify... ...multi-token prediction, quantized inference) map onto... ...Computer Science, Computer Engineering, Electrical... ...depth in GPU computing, ML systems, or high-performance...SeniorFull timeLocal area- Cerebras Systems, Inc. is looking for a Senior Performance Engineer to enhance the performance benchmarking and competitive... ...will have extensive experience with open-source inference frameworks and an understanding of ML systems. This role critically combines technical...Senior
$165k - $242k
Apply for the Senior Software Engineer II, Inference role at CoreWeave. CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave... ...of inference internals: batching, caching, mixed precision (BF16/FP8), streaming token delivery. Proven track...SeniorPermanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift work$139k - $204k
What You’ll Do Senior engineers are area owners who lead designs, raise engineering standards... ...teams to evolve our Kubernetes‑native inference platform and meet strict P99 SLAs at scale... ...internals: batching, caching, mixed precision (BF16/FP8), streaming token delivery....SeniorPermanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift work$139k - $257.55k
...customer experience. As a Senior Software Engineer focused on Data Science and... ...Engineering, you'll build the ML models that detect and... ...development, and real-time inference — building the models that... ...that sharpen detection. Track precision, recall, false positives, and...SeniorTemporary workLocal areaWorldwideShift work- Apple Inc. is seeking a Sr. Machine Learning Engineer for the Foundation Models Inference team in Santa Clara, CA. You will collaborate with research and external partners to bring cutting-edge model architectures from prototype to planetary-scale deployment, owning hard...Senior
$2,000 per month
...reasoning agents. Job Summary Etched’s Inference SW team enables optimal mapping of models... ...seeking a highly skilled and motivated engineer to join our team as we work towards... ...traces and logs from distributed systems and ML workloads. Built applications with...Full timeWork at officeRelocation packageEtched
San Jose, CA1 day ago- ...headquartered in Santa Clara, CA, seeks a Principal System Software Engineer for AI Inference Execution. You will join the software team to productize... ...stack, developing deployment software and collaborating with ML, compiler, and hardware experts. Required: strong...Senior
$110k - $190k
We are hiring a Senior Software & AI Engineer to build production-grade AI systems,... ...world use Apply traditional ML techniques where... ...infrastructure (training pipelines, inference optimization, monitoring)... ...advanced materials and high‑precision measurement. As our customers...Senior$131k - $213.5k
...create an environment where we all win with precision. Job Description Your Career We’re looking for a Software Engineer to join our Information Technology team and... ...systems, integrating AI models, or using AI/ML-based APIs where appropriate. If you thrive...SeniorFull timeWork experience placementCasual workWork at officePalo Alto Networks
Santa Clara, CA1 day ago$184k - $287.5k
NVIDIA GPU Architecture Group is seeking a senior software engineer to automate and optimize performance analysis workflows for AI training and inference workloads. You will not only perform... ...developer tools or platforms for ML engineersContributions to open-source AI...SeniorFull timeRemote work$224k - $356.5k
...drivers!We are looking for a senior engineer to own the engine that makes... ...metrics are measured against them (precision/recall), and how those... ...experience).12+ years building software, with significant time in autonomous... ..., robotics, or large-scale ML systems.Deep experience...SeniorFull timeRemote work$184k - $287.5k
...engage with Large-scale model inference architectureContribute to the... ....Deep knowledge of E2E AV software integration from perception through... ...To See:We’re looking for engineers who can build systems — not just... ...models or large-scale ML systemsHelped drive End-to-end...SeniorFull time$224k - $356.5k
...Platform Team is building the software foundation for scalable... ...for exceptional engineers who thrive on solving deeply... ....We are seeking a Senior Software Engineer for next... ..., deep learning inference, TensorRT and related compiler... ...systems software, AI/ML infrastructure, deep...SeniorFull time- ...critical to AMD’s AI software roadmap.AMD GPUs are an... ...scale AI training and inference.In this role you will... ...Triton/Gluon kernels for ML kernels powering the... ...architecture, and performance engineering. You are comfortable... ...attention, MoE, quantized kernels, etc), ensuring...Senior
$184k - $287.5k
We're looking for outstanding AI systems engineers to develop groundbreaking technologies in the inference systems software stack! We build innovative AI systems software to accelerate... ...6+ years (academic/ industry) experience with ML/DL systems development preferableStrong...SeniorFull timeRemote work$184k - $287.5k
...world.We are looking for outstanding Senior Deep Learning Software Engineers to develop and productize NVIDIA's... ...to accelerate deep learning inference on NVIDIA hardware platforms for Physical... ...compiler technologiesBackground with low precision inference, quantization,...SeniorFull timeWork experience placement$184k - $287.5k
...biological discovery. We are looking for a Senior Software Engineer to join the cuEquivariance team — an... ...delivery of GPU-accelerated geometric ML primitives: from implementation to... ...alongside CUDA.Experience with mixed-precision or tensor-core-aware algorithm design...SeniorFull time$152k - $241.5k
...reconstruction? We are looking for a driven Software Engineer to bring ground breaking models into... ..., build, and optimize containerized inference execution for the latest 3D VLMs from NVIDIA... ...contributor already?Experience with ML model engineering: training, fine-...SeniorFull time$143k - $191k
...talent decisions. We’re looking for a Software Engineer to design and build highly scalable, user... ...product managers, designers, and AI/ML engineers to bring intelligent agents to... ...backend services and APIs that support model inference, orchestration, and tool...SeniorWork at officeRemote workFlexible hours- ...Tuesday.About the RoleWe are seeking a Senior Software Engineer to join our Managed Kubernetes (Mk8s)... ...the next generation of AI training and inference at scale.As a Senior Engineer on our... ...patternsBuild internal tools and CLIs that let ML/AI teams deploy and monitor their own...SeniorWork at officeLocal areaWork from homeFlexible hours
- ...patients worldwide.We’re a team of engineers, clinicians, and innovators... ...teams perform with greater precision and patients recover faster,... ...of Position:As a Sr Software Engineer Navigation on the Future... ...sensor and robot data to CV/ML inference. This role spans the entire...SeniorLocal areaWorldwideFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer - Quantized Inference & ML Precision. Be the first to apply!
Related searches
- senior robotics software engineer Santa Clara, CA
- software system engineer Santa Clara, CA
- security software engineer Santa Clara, CA
- intel software engineer Santa Clara, CA
- software developer fintech Santa Clara, CA
- new graduate software engineer Santa Clara, CA
- software development engineer aws Santa Clara, CA
- information technology software engineer Santa Clara, CA
- graduate software developer no experience Santa Clara, CA
- software developer internship no experience Santa Clara, CA