Senior LLM Inference Engineer — Distributed Systems
Qualcomm
Qualcomm Technologies, Inc. is seeking experienced software engineers to advance the software ecosystem for large-scale LLM inference on Qualcomm platforms in Santa Clara, CA. You will work across open-source LLM serving projects, distributed systems, cloud-native infrastructure, and accelerator software to enable scalable, production-grade LLM workloads. You will contribute to llm-d and related tools, integrate with Qualcomm AI accelerators, and collaborate with upstream communities to shape #J-18808-Ljbffr Qualcomm
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior LLM Inference Engineer — Distributed Systems in Santa Clara, CA vacancy
$162k - $243k
...Qualcomm Technologies, Inc. Job Area: Engineering Group, Engineering Group Machine... ...software ecosystem for large-scale LLM inference on Qualcomm platforms. In this... ...intersection of open-source LLM serving systems, distributed systems, cloud-native infrastructure,...SeniorWork experience placementWork from homeQUALCOMM, Inc.
Santa Clara, CA2 days ago- ...Technologies, Inc. is seeking experienced software engineers to advance the software ecosystem for large-scale LLM inference on Qualcomm platforms. You will work at the intersection of open-source LLM serving systems, distributed systems, and cloud-native infrastructure,...Senior
- ...what’s possible with LLM inference on heterogeneous hardware... ...proof-of-concept systems that showcase D-Matrix... ...applied research and engineering team that moves fast,... ...optimization to distributed orchestration to high... ...real hardware.Small, senior team with high autonomy...Senior
d-Matrix
Santa Clara, CA4 days ago - Apple Inc. is seeking senior software engineers to join the Observability team within the Apple Services Engineering (ASE). You will design and build fault-tolerant, high-performance distributed systems that scale globally and remain highly available to support Apple’s...SeniorWorldwide
- Nokia in Sunnyvale, CA is seeking a Senior Software Engineer to drive Go-based distributed systems and edge compute platforms. You will design scalable microservices, leverage Kubernetes internals for deployment and resource management, and mentor teammates in a fast-paced...Senior
- Google's software engineers develop the next-generation technologies that change how billions of users connect, explore... ...who bring fresh ideas across information retrieval, distributed computing, large-scale system design, networking and data storage, security, AI, NLP...Senior
$150.4k - $277.6k
...Senior Software Engineer - Distributed Systems Cupertino, California, United States Machine Learning and AI Our team is on a mission to build innovative infrastructure and tools to help other engineers be more productive and make software easier to create, build...SeniorRelocationApple Inc.
Cupertino, CA2 days ago- Google LLC in Sunnyvale, CA is seeking a Senior Software Engineer, Infrastructure, Spanner to design and optimize distributed storage systems at scale. You will work on core Spanner features, collaborating with product teams to deliver high-availability solutions for global...Senior
$190.1k - $285.1k
...building a large-scale distributed data and observability... ...the platform, so our systems get smarter about surfacing... ...alongside world-class engineers building the platforms... ...team is hiring a Senior or Mid-Level Software... ...Hands-on experience with LLM orchestration...SeniorWork at officeRemote workWorkday, Inc.
Santa Clara, CA1 day ago- ...the end-to-end performance analysis and optimization of LLM and VLM inference on NVIDIA GPU-accelerated systems. Develop performance-critical kernels and contribute improvements to open-source inference engines to reduce latency and increase throughput. Requires over...Senior
- Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs... ...deliver industry-leading training and inference speeds; over 10 times faster than... ...inference. Cerebras is seeking a Distributed Systems Security Engineer to help build out the next generation...Senior
- ...operates ultra-scale GPU supercomputing systems to train next-generation foundation models... ...— driving communication performance, distributed reliability, and cross-layer optimization... ...We are looking for a deeply technical engineer to co-design and optimize the communication...Senior
Institute of Foundation Models
Sunnyvale, CA2 days ago $152k - $241.5k
NVIDIA is hiring experienced software engineers with kubernetes experience to help scale up... ...Cloud team responsible for production systems that enable large scalable GPU clusters... ...in managing and automating large-scale distributed systems independent of cloud providers....SeniorFull timeNvidia
Santa Clara, CA4 days ago- ...PCs, gaming and embedded systems. Grounded in a culture of... ...ROLE:We are looking for a Senior GPU Inference Performance Engineer to own end-to-end... ...reading a GPU trace, debugging distributed systems performance issues... ...) on standardized AI and LLM workloads. Produce clear,...Senior
AMD
Santa Clara, CA6 days ago - ...seeking a Sr. Staff ML Researcher to advance LLM algorithmic optimization on our DNN accelerators. You will design and implement efficient inference algorithms, collaborating with mathematicians, ML researchers and engineers on high-impact research at the math-ML boundary...Senior3 days per week
- Netris, Inc. is seeking a Senior / Staff Backend Engineer to design and own the distributed control‑plane services behind the platform. You’ll translate requirements into scalable, production‑grade architectures and take ownership of reliability, observability, and long...SeniorRemote job
- GEICO is seeking a senior/lead software engineer to drive AI-powered product development and... ...requires crafting scalable production systems and mentoring peers in AI and LLM implementations. You will... ...Generative AI, LLMs, and distributed architectures, ensuring robust,...Senior
- CoreWeave is Hiring for a senior role in Sunnyvale, CA, focusing on Applied Training and a Kubernetes-native research cluster platform... ...teams. The position emphasizes extensive experience with distributed systems, Kubernetes, and scalable workflows, with a base salary...SeniorFull time
$193.3k - $261.5k
We are looking for a Senior Inference Engineer to own inference for real-time multimodalconversational... ...such as Nsight Compute/Systems and rooflineanalysis to... ...that fall outside standard LLM serving patterns —... ...- Experience with distributed training and post-training...SeniorInternshipLocal areaFlexible hoursAmazon
Sunnyvale, CA2 days ago$175k - $308.5k
Apple's distributed build platform is central to the development and delivery of every operating system and app we ship. Tens of thousands of engineers rely on it daily to develop software that ships to... ...Description We're looking for senior software engineers who...SeniorImmediate startRelocation- ...Senior / Staff Backend Engineer – Distributed Systems & Network Automation About Netris Netris is the leading network automation platform for AI clouds. AI is the largest infrastructure buildout in history, and networking is its bottleneck. Netris is the automation...SeniorRemote workFlexible hours
Netris, Inc.
Santa Clara, CA2 days ago - NVIDIA AI in Santa Clara seeks an experienced software engineer to design and build distributed services and data pipelines for GPU capacity, reservations... ...visibility, leveraging Python/Go/Java and cloud-native tech in production systems. #J-18808-Ljbffr NVIDIA AISenior
$224k - $356.5k
...NVIDIA is hiring a Senior Software Architect... ...Harness & Runtime Engineering team to build foundational systems for the next generation... ...agent runtimes, inference, evaluation, and large... ...challenges across distributed execution, data/ETL... ...Crowd:Knowledge of LLM/VLM inference,...SeniorFull timeRemote workNvidia
Santa Clara, CA2 days ago$163.43k - $190k
...the IonQ Tempo, is the latest in a line of cutting-edge systems that have been helping customers and partners including... ...The Role: We are looking for a deeply hands-on Senior Distributed Systems Engineer to join the team building IonQ's Network and Security Platform...SeniorPermanent employmentContract workWork at officeIonQ Inc.
Santa Clara, CA2 days ago- Institute of Foundation Models in Sunnyvale, CA seeks a deeply technical engineer to co-design and optimize the communication stack for large-scale distributed training, including hybrid parallelism and Mixture-of-Experts workloads. This role emphasizes performance engineering...Senior
- ...Foundation Models designs ultra-scale GPU systems to train foundation models and optimize cross... ...scalability. We seek a deeply technical engineer to co-design and optimize the communication stack for large-scale distributed training, including MoE workloads, hybrid parallelism...Senior
$136.5k - $276.5k
Senior Distributed Storage System EngineerThis role has been designed as ‘’Onsite’ with an expectation that you will primarily work from an HPE office... ...Leads multiple project teams of other software systems engineers and internal and outsourced development partners...SeniorWork experience placementWork at officeLocal areaHewlett Packard Enterprise
San Jose, CA2 days ago$184.7k - $324.8k
...'re looking for an experienced backend engineer to design and build massively scalable,... ...Apple customers. Description As a senior member of the Services Engineering Team... ..., scaling what exists, and applying distributed-systems best practices from design through production...SeniorContract workRelocationApple Inc.
Cupertino, CA1 day ago- Morph Systems in Mountain View, CA is seeking a Software Engineer with a deep systems background to design, build, and scale Morph’s LLM-powered development stack. You’ll work on compilers, databases, and distributed systems at a small, high-caliber team. This role intersects...Senior
- Apple Inc. in Cupertino, California, seeks a Senior Software Engineer focused on distributed systems to help build high‑performance infrastructure, storage and backend services for Apple-scale workloads. You will collaborate with cross‑functional teams to refine requirements...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior LLM Inference Engineer — Distributed Systems. Be the first to apply!
Related searches
- systems engineering technician Santa Clara, CA
- director systems engineering Santa Clara, CA
- senior windows systems engineer Santa Clara, CA
- system design engineer Santa Clara, CA
- ground systems engineer Santa Clara, CA
- system engineer contract Santa Clara, CA
- system performance engineer Santa Clara, CA
- software system engineer Santa Clara, CA
- visual systems engineer Santa Clara, CA
- electronic systems engineer Santa Clara, CA