Senior LLM Inference Engineer: Infra & Accelerators
QUALCOMM, Inc.
Qualcomm Technologies, Inc. is seeking experienced software engineers to advance the software ecosystem for large-scale LLM inference on Qualcomm platforms. You will work at the intersection of open-source LLM serving systems, distributed systems, and cloud-native infrastructure, contributing to llm-d and related engines to run efficiently on Qualcomm accelerators. You may focus on distributed LLM serving or inference runtime and accelerator integration while collaborating across both areas. #J-18808-Ljbffr QUALCOMM, Inc.
Vacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the Senior LLM Inference Engineer: Infra & Accelerators in Santa Clara, CA vacancy
$162k - $243k
...Qualcomm Technologies, Inc. Job Area: Engineering Group, Engineering Group > Machine Learning... ...software ecosystem for large-scale LLM inference on Qualcomm platforms. In this role,... ..., cloud-native infrastructure, and AI accelerator software. You will contribute to open-...SeniorWork experience placementWork from home$184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its performance ceiling? Our LLM Inference... ...three interconnected systems, all aimed at accelerating NVIDIA's LLM inference stack. The first is...SeniorFull timeNvidia
Santa Clara, CA2 days ago$193.3k - $261.5k
We are looking for a Senior Inference Engineer to own inference for real-time multimodalconversational... ...streaminggenerative models that fall outside standard LLM serving patterns — sustained low-... ..., KV-cache management, and the accelerator programming model- Demonstrated...SeniorInternshipLocal areaFlexible hoursAmazon
Sunnyvale, CA1 day ago- ...mission is to build great products that accelerate next-generation computing... ...career. THE ROLE:We are looking for a Senior GPU Inference Performance Engineer to own end-to-end performance analysis... ...vs. NVIDIA) on standardized AI and LLM workloads. Produce clear, data-...Senior
AMD
Santa Clara, CA17 hours ago $152k - $241.5k
We are looking for a passionate and energized engineer to accelerate the integration of APIs across the CUDA-X math library software stack into modern LLM and agentic AI workflows. Leading organizations globally are using GPU-powered data centers for AI, data analytics...SeniorFull timeRemote workNvidia
Santa Clara, CA2 days ago$124.5k - $272k
...era. We secure and accelerate cloud, data, and... ...platform, its Zero Trust Engine, and the powerful... ...are available at Senior Staff and above.... ..., you own the inference and optimization layer... .../SGLang, TensorRT-LLM, ONNX Runtime,... ...distill a model or infra bottleneck into an...SeniorNetskope
Santa Clara, CA1 day ago- ...edge of what’s possible with LLM inference on heterogeneous hardware.... ...are an applied research and engineering team that moves fast, ships... ...with CPUs, GPUs, and custom accelerators. Our work powers everything... ...work and real hardware.Small, senior team with high autonomy and...Senior
d-Matrix
Santa Clara, CA3 days ago $119.8k - $234.7k
...Hardware, and Infrastructure Engineering (SCHIE) is the team behind Microsoft... ...-leading AI training and inference. The Platform Systems... ...PSE) team is seeking a Sr. AI Accelerator Tools Development Engineer to... ...including: HPL/HPC benchmarks LLM training workloads Transformer...SeniorOngoing contractWork at officeLocal areaWorldwide3 days per weekMicrosoft
Mountain View, CA1 day ago$159k - $198.8k
...force for business. Job Description:Staff Inference Engineer -Uniphore is building an enterprise AI... ...data in real time. We are looking for a Senior or Staff Inference Engineer to own the inference... ...with vLLM, SGLang, or TensorRT-LLM• Strong Python and C++ (C++17/20)ti ability...SeniorFull timeUniphore
Palo Alto, CA1 day ago$184k - $287.5k
We are now looking for a Senior High-Performance LLM Training Engineer!NVIDIA is seeking experienced engineers specializing in performance analysis and optimization to improve the efficiency of LLM training workloads, which are shaping the world's most advanced computing...SeniorFull timeWork experience placementNvidia
Santa Clara, CA2 days ago- ...Mirantis empowers platform engineering teams to deliver... ...hardware vendor. We sell accelerated compute: GPU clusters,... ...stood up training and inference workloads, argued... ...with a customer's ML infra lead, and closed large... ...NeMo, Triton / TensorRT-LLM, Base Command, Run:ai...SeniorFull time
Mirantis
San Jose, CA4 days ago $193.3k - $261.5k
...Learning servers. Our team builds C++ & SystemC functional models of these custom-designed accelerator SoCs for use by AWS internal teams. We’re looking for a Senior SoC Modeling Engineer to join the team and deliver new functional models, infrastructure, and tooling for...SeniorInternshipLocal areaFlexible hoursAmazon
Cupertino, CA17 hours ago- Cerebras Systems is seeking a Software Engineer to productionize and optimize the GPU serving stack, spanning custom inference APIs, the vLLM runtime, ROCm, and rack-scale AMD GPU infrastructure. You will write production code, establish deployment and health-checking practices...Senior
$184k - $287.5k
...millions globally. We seek a Senior Engineer to lead technical efforts in... ...By combining powerful local inference (Nemotron models) with strong... ...architecture.Proven understanding of LLM inference pipelines (Ollama, Llama.cpp, vLLM), GPU-accelerated computing (CUDA, TensorRT),...SeniorFull timeLocal areaShift workNvidia
Santa Clara, CA17 hours ago$152k - $241.5k
...world.As a Developer Technology Engineer, you will be at the forefront... ...for analyzing most demanding accelerated end-to-end agentic AI... ...runtime performance.Improve LLM & GenAI user experience by working... ...Experience with GPU-accelerated AI inference driven by NVIDIA APIs and...SeniorFull timeLocal areaNvidia
Santa Clara, CA2 days ago$184k - $287.5k
...powered application is built. We are seeking a Senior Software Engineer - AI Inference Performance to advance innovative LLM and VLM inference. You will push workloads... ...toward practical performance limits on NVIDIA GPU-accelerated systems. Your work will span models, serving...SeniorFull timeNvidia
Santa Clara, CA2 days ago$184k - $287.5k
NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you... ...design, build, and optimize the GPU-accelerated software that powers today’s... ...for state-of-the-art LLM and Generative AI models across...SeniorFull timeNvidia
Santa Clara, CA1 day ago$168k - $270.25k
...is the world leader in accelerated computing and AI. Our technologies... ...and NVIDIA Inference Microservices (NIM), enabling... .... We are looking for a senior, technically strong test development engineer to drive quality,... ...improve testabilityValidate LLM and AI inference...SeniorFull timeNvidia
Santa Clara, CA2 days ago$168k - $270.25k
...graphics, PC gaming, and accelerated computing for more than 25... ...Marketing Organization seeks a senior Site Reliability Engineer (SRE) to join our Santa... ...tracking model drift and inference latency.What we need to see... ...and scaling Generative AI/LLM applications, integrating...SeniorFull timeNvidia
Santa Clara, CA3 days ago- NVIDIA Corporation is seeking a Senior Software Engineer to advance DriveOS tooling and automation infrastructure. You will design scalable automation... ...reliability. You will architect AI-native pipelines with LLM agents, integrate RAG systems, and shape engineering...SeniorFull time
$206k - $275k
...across the company—Finance, GTM, Engineering, and People—to implement... ...frontends, etc.) integrated with LLM workflows to automate daily... ...latency, and control inference costs across teams.Automate Operational... ..., serverless functions, and infra pipelines (Vercel, AWS/GCP,...SeniorWork at officeLocal areaWork from homeFlexible hoursLambda Labs
San Jose, CA8 hours ago$136k - $218.5k
...transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It... ...silicon design? We’re seeking a Senior VLSI Methodology Engineer to join our team and to design... ...model calibrationApplied AI/ML/LLM experience to enhance EDA tools, automation...SeniorFull timeNvidia
Santa Clara, CA3 days ago$272k - $431.25k
NVIDIA is seeking a Principal Engineer to drive the performance of large-scale AI training... ...analyze and optimize frontier-scale LLM workloads running on thousands of GPUs,... ...workloads.Strong understanding of GPU and AI accelerator architecture from individual...Full timeNvidia
Santa Clara, CA2 days ago$184k - $287.5k
NVIDIA is seeking an NCX Senior Engineer to join our DSX team, collaborating closely with strategic... ..., including distributed training, inference optimization, and MLOps pipelines... ...repeatable deployment and configuration of GPU‑accelerated clusters and NCP building blocks....SeniorFull timeRemote workNvidia
Santa Clara, CA2 days ago$135.91k - $223.29k
Role SummaryWe are looking for a Senior AI Engineer to lead the transformation of our marketing ecosystem... ...with PyTorch or TensorFlow, and LLM orchestration frameworks (LangChain,... ...understanding of Bayesian A/B testing and causal inference to measure the true uplift of AI...SeniorTemporary workRelocation packageFlexible hoursMcAfee
San Jose, CA1 day ago- ...Job Title: Senior Forward Deployed Engineer (FDE) Location: Hybrid, Palo Alto, CA... ...technical best practices and accelerate solution delivery through reusable... .... • Stay current on RAG, LLM/SLM advancements, Agentic... ...frameworks, GPU/Infra trends, fine tuning techniques...Senior
Tranzeal
Palo Alto, CA4 days ago $2,500 per month
...Description Job Summary Our Internal Acceleration team’s mandate is to build... ...write. This role is for engineers who thrive on ambiguity, have... ...you ship works Have built LLM agents or AI tooling that... ...Lesson. We are the first inference-focused frontier AI system, betting...Work at officeRelocation packageEtched
San Jose, CA3 days ago$136k - $212.75k
As a Performance Engineer at NVIDIA, you will be part of a team that’s advancing the limits... ...to work at the forefront of AI, accelerated computing, and modern graphics technologies... ...of Professional Visualization, AI, and LLM benchmark applications on various GPUsDevelop...SeniorFull timeNvidia
Santa Clara, CA4 days ago$184k - $287.5k
...“the AI computing company”.We're looking for a Senior Performance Compiler Engineer to join our team and work on the open-source Triton... ...agents, and other high-impact AI applications, accelerating both training and inference. You will be immersed in a diverse, supportive...SeniorFull timeRemote workNvidia
Santa Clara, CA2 days ago$174k - $252k
Google Sunnyvale, CA, USA is seeking a Senior Software Engineer, Infrastructure, AlloyDB to advance high‑performance distributed systems and PostgreSQL‑compatible database internals within AlloyDB. You will write and test code, participate in design reviews, and help improve...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior LLM Inference Engineer: Infra & Accelerators. Be the first to apply!
Related searches
- senior business development Santa Clara, CA
- senior devops engineer remote Santa Clara, CA
- senior information technology project manager Santa Clara, CA
- senior vmware engineer Santa Clara, CA
- sr electrical engineer Santa Clara, CA
- sr marketing manager Santa Clara, CA
- senior dynamics crm developer Santa Clara, CA
- senior development executive Santa Clara, CA
- senior research scientist Santa Clara, CA
- senior director Santa Clara, CA