Senior LLM Inference Systems Engineer - Open-Source & Cloud
Qualcomm
Qualcomm Technologies, Inc. seeks experienced software engineers to advance large-scale LLM inference on Qualcomm platforms. You will work at the intersection of open-source LLM serving systems, distributed software, cloud-native infrastructure, and accelerator software to enable efficient, reliable deployments on Qualcomm accelerators. You will focus on distributed LLM serving or inference runtime and accelerator integration, collaborating across both areas and with leading open-source #J-18808-Ljbffr
Vacancy posted 13 hours ago
Similar jobs that could be interesting for youBased on the Senior LLM Inference Systems Engineer - Open-Source & Cloud in Santa Clara, CA vacancy
$162k - $243k
...Technologies, Inc. Job Area: Engineering Group, Engineering Group... ...software ecosystem for large-scale LLM inference on Qualcomm platforms. In... ...work at the intersection of open-source LLM serving systems, distributed systems, cloud-native infrastructure, and AI...CloudSeniorWork experience placementWork from homeQUALCOMM, Inc.
Santa Clara, CA4 days ago- ...Inc. is seeking experienced software engineers to advance the software ecosystem for large-scale LLM inference on Qualcomm platforms in Santa Clara, CA. You will work across open-source LLM serving projects, distributed systems, cloud-native infrastructure, and...CloudSenior
- ...gaming and embedded systems. Grounded in a... ...the framework-layer inference product strategy for... ..., ecosystem, and engineering signals into... ...partners, and the open-source inference community... ....Collaborate with cloud providers, model developers... ...systems such as llm-d, along with...CloudSeniorRemote workShift work
AMD
Santa Clara, CA6 days ago $184k - $287.5k
...change how the AI inference industry works. With... ...vast NCP (NVIDIA Cloud Partner)... ...executives, distinguished engineers and datacenter developers... ...their businesses, systems and infrastructure... ...using TensorRT-LLM, vLLM, SGLang, and... ....Contributions to open-source projects relevant...CloudSeniorFull timeNvidia
Santa Clara, CA4 days ago$195.2k - $262.2k
...leading a new era in cloud infrastructure... .... Built by engineers, for engineers.... ...to inference optimization, we... ...of distributed systems, GPU performance... ...engineering. A Senior MLE owns substantial... ...rollouts. Optimize LLM and VLM... ...engineering role. Open‑source contributions to...CloudSeniorTemporary workImmediate startRemote work$208k - $327.75k
...Product Manager for Inference Platform, you will... ...of models, both open source and proprietary. You... ..., infrastructure engineering, and real user... ...broader ecosystem of AI Cloud partners. The... ...familiarity with AI/ML systems and inference... ...(such as TensorRT-LLM, vLLM, or Triton Inference...CloudSeniorFull timeNvidia
Santa Clara, CA6 days ago- Advanced Micro Devices is looking for a Senior Product Manager in Santa Clara,... ...roadmaps, engage with the open-source community, and partner with engineering teams to meet customer needs. Successful... ..., GPU computing, and AI inference technologies. This role provides...Senior
$195.2k - $262.2k
...leading a new era in cloud infrastructure... .... Built by engineers, for engineers.... ...to inference optimization, we... ...capabilities. A Senior Applied Scientist... ...programs in efficient LLM and VLM... ...blog posts, and open-source artifacts that... ...rigor, and model/system tradeoffs. Must...CloudSeniorTemporary workImmediate startRemote work- ...NVIDIA is seeking a System Software Engineer - Agentic Retrieval to build and optimize GPU-accelerated... ...multimodal content. You will collaborate with LLM researchers to create scalable,... ...Generative AI workflows. The role emphasizes cloud familiarity, MLOps, and cross-...CloudSenior
NVIDIA
Santa Clara, CA5 days ago - Google LLC is seeking a Security Engineer in Sunnyvale, CA to protect network boundaries, harden systems, and safeguard customer data.... ...secure silicon projects in an open source context. The role emphasizes... ...security architectures across Google Cloud platforms. #J-18808-Ljbffr...CloudSenior
- Cerebras Systems builds the world's largest... ...training and inference speeds; over 10... ...based hyperscale cloud inference services... ..., hands-on Senior Software Development Engineer in Test (SDET) to... ...infrastructure, LLM inference, model... ...GPU.Publish and open source their cutting-edge...CloudSeniorWork at officeRemote work3 days per week
Cerebras Systems
Sunnyvale, CA3 days ago $224k - $356.5k
...We are looking for a Senior System Software Engineer to work on Dynamo-Triton Inference Server. NVIDIA is hiring... ...Large Language Model (LLM) and non-LLM workloads... ...active member of the open source deep learning software... ...production server or cloud environments, optimizing...CloudSeniorNVIDIA Corporation
Santa Clara, CA1 day ago- Cerebras Systems builds the world's largest... ...training and inference speeds; over 10... ...hyperscale cloud inference services... ..., and product engineering teams to ensure... ...The RoleAs a Senior Software Engineer... ...including LLM and/or multimodal... ...GPU.Publish and open source their cutting-edge...CloudSeniorWork at officeRemote workShift work3 days per week
Cerebras Systems
Sunnyvale, CA7 days ago - ...Cerebras Systems builds the world's largest AI chip... ...-leading training and inference speeds; over 10 times... ...GPU-based hyperscale cloud inference services. This... ...Distributed Systems Security Engineer to help build out the... ...the GPU. Publish and open source their cutting-edge AI...CloudSenior
Cerebras
Sunnyvale, CA3 days ago - ...gaming and embedded systems. Grounded in a... ...is seeking a Senior Product Manager... ...ROCm, AMD’s open‑source GPU software stack... ...‑scale model inference on AMD Instinct... ...will influence engineering roadmaps, represent... ..., RedHat, and cloud providers on... ...understanding of LLM inference,...CloudSeniorRemote work
Advanced Micro Devices , Inc.
Santa Clara, CA3 days ago - ...Anyscale is seeking a Senior / Staff Product... ...balancing open source growth with commercial... ...performance commercial engine. You'll own the... ...background in distributed systems, ML infrastructure... ...offline batch inference and data... ...CoreWeave, and Google Cloud are putting AI-native...CloudSeniorRelocationFlexible hours
$148k - $270k
...complexities of AI systems, we’re... ...State-of-the-art inference is a fast moving... ...Altos, CA. More senior staff can work... ...the metal to the cloud. Developing... ...interfaces for open-source model developers... ...why defensive engineering is worth the extra... ..., SGLang, TRT-LLM, etc.) Broad...CloudWork experience placementWork at officeLocal areaRemote workVisa sponsorshipFlexible hoursModular Inc
Los Altos, CA1 day ago$150.4k - $277.6k
...Senior Software Engineer, Private Cloud Compute Inference Routing Cupertino, California, United States... ...You'll design distributed systems that direct inference... ...Description Routing LLM inference at Apple's scale... ...make an impact are wide open. If you take opportunities...CloudSeniorRemote workWorldwideRelocationApple Inc.
Cupertino, CA1 day ago$224k - $356.5k
...NVIDIA is hiring a Senior Software Architect... ...Harness & Runtime Engineering team to build foundational systems for the next generation... ...agent runtimes, inference, evaluation, and large... ...pipelines, HPC, cloud, Kubernetes, and GPU... ...Crowd:Knowledge of LLM/VLM inference, model...CloudSeniorFull timeRemote workNvidia
Santa Clara, CA3 days ago$184k - $287.5k
...network stack for distributed inference which will be used to orchestrate wide area networks/cloud Networks. Enabling a workload... ...Computer Science, Electrical Engineering, Software Engineer, or... ...building cloud-grade networks using open-source tools and orchestration...CloudSeniorFull timeWork experience placementNvidia
Santa Clara, CA8 days ago- ...the end-to-end performance analysis and optimization of LLM and VLM inference on NVIDIA GPU-accelerated systems. Develop performance-critical kernels and contribute improvements to open-source inference engines to reduce latency and increase throughput. Requires over...Senior
- Cerebras Systems builds the world's largest AI chip,... ...-leading training and inference speeds; over 10 times... ...GPU-based hyperscale cloud inference services. This... ...excellent opportunity for engineers who enjoy... ...of the GPU.Publish and open source their cutting-edge AI...CloudSenior
Cerebras Systems
Sunnyvale, CA6 days ago $182k - $242k
...The Essential Cloud for AI™. Built... ...You'll Do: IT Engineering at CoreWeave designs... ...operates the systems that enable our... ...is hiring a Senior AI Platform Engineer... ..., hands-on LLM and agent work,... ...with data-source scoping across... ...that run it. Inference endpoints, agent...CloudSeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursShowcify, Inc.
Sunnyvale, CA1 day ago- Cerebras Systems builds the world's largest... ...leading training and inference speeds; over 10... ...-based hyperscale cloud inference services... ...Cerebras' Wafer-Scale Engine (WSE). We build... ...support for emerging LLM architectures and... ...GPU.Publish and open source their cutting-edge...CloudSenior
Cerebras Systems
Sunnyvale, CA7 days ago - Cerebras Systems builds the world's largest AI chip,... ...-leading training and inference speeds; over 10 times... ...GPU-based hyperscale cloud inference services. This... ...software systems that power engineering workflows across... ...of the GPU.Publish and open source their cutting-edge AI...CloudSenior
Cerebras Systems
Sunnyvale, CA8 days ago - Cerebras Systems builds the world's largest AI chip... ...training and inference speeds; over 10 times... ...GPU-based hyperscale cloud inference services.... ...RoleWe’re hiring a Senior Fullstack Engineer to own and scale critical... ...the GPU.Publish and open source their cutting-edge...CloudSeniorShift work
Cerebras Systems
Sunnyvale, CA5 days ago - ...what’s possible with LLM inference on heterogeneous hardware... ...proof-of-concept systems that showcase D-Matrix... ...applied research and engineering team that moves fast,... ...the internals of open-source inference frameworks... ...real hardware.Small, senior team with high autonomy...Senior
d-Matrix
Santa Clara, CA6 days ago $119.8k - $234.7k
...MicrosoftOverviewMicrosoft Silicon, Cloud Hardware, and Infrastructure Engineering (SCHIE) is the team... .... Microsoft's Hardware Systems organization is... ...leading AI training and inference. The Platform Systems Engineering... ...internal, external, and open-source partners to seamlessly...CloudSeniorOngoing contractWork at officeLocal areaWorldwideFlexible hours3 days per weekMicrosoft
Mountain View, CA5 days ago- ...Software EngineerCerebras Systems builds the world's... ...-leading training and inference speeds; over 10 times... ...GPU-based hyperscale cloud inference services. This... ...software systems that power engineering workflows across... ...of the GPU.Publish and open source their cutting-edge AI...CloudSeniorRemote work
CEREBRAS SYSTEMS INC.
Sunnyvale, CA11 hours ago - ...'re a group of engineers, researchers, and... ..., identity, cloud, and application... ...will run at. As a Senior Red Team... ...and membership inference to understand how... ...on AI offense. LLM and agent exploitation... ...chains, system prompt extraction... ...LLM traffic, or open‑source AI red team...CloudSeniorOdd jobWork at officeRemote workFlexible hoursShift work
Armadin
Palo Alto, CA5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior LLM Inference Systems Engineer - Open-Source & Cloud. Be the first to apply!
Related searches
- systems engineering technician Santa Clara, CA
- director systems engineering Santa Clara, CA
- senior windows systems engineer Santa Clara, CA
- system design engineer Santa Clara, CA
- ground systems engineer Santa Clara, CA
- system engineer contract Santa Clara, CA
- system performance engineer Santa Clara, CA
- software system engineer Santa Clara, CA
- visual systems engineer Santa Clara, CA
- electronic systems engineer Santa Clara, CA