Senior LLM Inference Architect — Heterogeneous Hardware
d-Matrix inc.
d-Matrix inc. is hiring end-to-end inference engineers to innovate LLM solutions in Santa Clara, CA. You will work with novel hardware and software to optimize performance and deploy advanced inference systems. Ideal candidates possess strong Python and C/C++ skills, along with a deep understanding of generative AI architectures and extensive experience in performance optimization of LLM frameworks. Join a small, senior team committed to cutting-edge AI development. #J-18808-Ljbffr d-Matrix inc.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior LLM Inference Architect — Heterogeneous Hardware in Santa Clara, CA vacancy
- d-Matrix in Santa Clara is hiring end-to-end inference engineers to optimize LLM performance on heterogeneous hardware. Join a cutting-edge team pushing the limits of AI technology. Your role includes prototyping use cases and building proof-of-concept systems. Candidates...Senior
$208k - $327.75k
...We are looking for a Senior AI Architect to help define the next... ...AI research, hardware architecture, systems... ...mapping AI workloads onto heterogeneous compute architectures... ...systems, scaling laws, and inference optimization... ...Triton, or TensorRT-LLM.Experience influencing...SeniorWorldwide- ...hiring end-to-end inference engineers who are... ...SGLang, TensorRT-LLM, etc.) and can... ...cases — exploring heterogeneous deployment topologies... ...of novel hardware and frontier models... ...closely with hardware architects to provide... ...hardware. Small, senior team with high autonomy...Suggested
$160k - $180k
Arista Networks is seeking a Hardware Design Engineer located in Santa Clara, California. This role focuses on developing high-speed Ethernet products essential for Enterprise campuses and AI clusters. You'll be responsible for the entire hardware design process from specifications...Senior$224k - $356.5k
NVIDIA Gruppe is seeking a Senior Deep Learning Software Engineer in Santa Clara to design and build an automated inference and deployment solution. You will focus on defining a scalable DL architecture that integrates with frameworks like PyTorch and JAX. Ideal candidates...Senior- NVIDIA Gruppe is looking for a Senior Deep Learning Computer Architect to design hardware accelerator architectures that enable cutting-edge AI algorithms. The role involves collaborating with diverse teams and contributing to innovations that enhance deep learning performance...Senior
- NVIDIA Gruppe is looking for an expert to optimize AI training workloads on cutting-edge hardware and software platforms. Applicants should have a PhD in a relevant field, extensive experience in deep learning, and strong programming skills in C++, Python, and CUDA. The...Senior
$184k - $287.5k
...you can make a lasting impact on the world. Responsibilities Architecting and maintaining custom profiling frameworks that provide a unified... ...smarter memory pooling. Developing predictive models to guide hardware procurement and cloud instance selection based on built gate-...Senior$152k - $241.5k
About the Role We are seeking a Senior Hardware SoC Architect to help define next‑generation SoC architectures that combine NVIDIA GPUs, custom processors and accelerators. The role is cross‑disciplinary, working with software, ASIC design, verification, physical design...Senior$224k - $356.5k
...Overview As an AI Storage Platform Architect at NVIDIA, this position will... ...between cutting‑edge hardware platforms and real‑world AI deployments... ...for disaggregated inference (aligned with NVIDIA Dynamo),... ...disaggregated inference architectures, LLM training pipelines, and...Senior- ...for a Deep Learning Communication Architect. We scale the DNN models and training/inference frameworks to systems with... ...communication overhead and latency. Hardware and software co‑craft: Collaborate... ...evaluating, analyzing, and optimizing LLM training and inference...SeniorWork experience placement
- NVIDIA Gruppe is looking for a Senior GPU & Deep Learning Architect to join its GPU Architecture group in California. In this role, you will lead efforts to design hardware for deep learning and advance parallel computation across projects. The ideal candidate will hold...Senior
$170.4k - $275.73k
...Job Summary About the Role We are hiring a Sr Principal RF Hardware Engineer to serve as a technical leader for the design and architecture... ...the most challenging technical work yourself, mentor Staff and Senior engineers, and partner closely with antenna vendors, systems,...SeniorFull timeWork at office- ...Ventures in Santa Clara is seeking end-to-end inference engineers to work on innovative AI... ...challenges unique to D-Matrix's groundbreaking hardware. Excellent communication, experience... ...and opportunity for influence within a senior team. #J-18808-Ljbffr Entrada VenturesSenior
- NVIDIA Gruppe is looking for a skilled engineer to join their TensorRT Edge-LLM team in Santa Clara, California. The role involves developing a state-of-the-art inference framework for large language models and optimizing it for real-time performance on embedded platforms...Senior
$272k - $431.25k
...transport optimization, hardware-software co-design... ...This Principal Architect role leads the... ..., DPUs, NICs, and heterogeneous storage. It requires... ..., and TensorRT-LLM. Publishing findings... ..., and mentoring senior engineers across... ...distributed training and inference patterns. ~...$208k - $327.75k
..., and we ’re seeking a visionary Product Architect with strong expertise in systems architecture... ...Collaborate with internal hardware, software, security and systems teams to... ...including agentic & RAG-based workflows, inference at scale, large scale training & fine-tuning...SeniorNVIDIA
Santa Clara, CA18 hours ago$184k - $356.5k
NVIDIA Gruppe in Santa Clara is seeking an experienced engineer to create and maintain custom profiling frameworks across CPU and GPU environments. You will carry out in-depth benchmarking and utilize profiling tools to identify inefficiencies in GPU computing. This role...Senior$320k
NVIDIA Gruppe is seeking a Distinguished Engineer to join the Dynamo engineering team in Santa Clara, California. The successful candidate will provide technical leadership and drive product direction while working on state-of-the-art AI inferencing technologies. With a...Senior- ...leading technology company in Cupertino is seeking a Senior Software Engineer to develop innovative AI-powered iOS... ...role involves collaborating with ML researchers and architecting scalable software for on-device LLM integration, impacting how users interact with AI daily...Senior
$156k - $229k
A leading tech company in Sunnyvale, CA, is seeking a Mid-level Design Verification Engineer. In this role, you will shape cutting-edge TPU technology for AI/ML applications. You will be responsible for verifying complex digital designs, collaborating with design teams,...Senior- ...imaging systems and a relevant Bachelor's degree, with strong project management and leadership skills. This position involves driving hardware technology from concept to production and ensuring performance optimization in consumer electronics. A competitive salary of $159,...Senior
- Google Inc. is seeking a Senior Manufacturing Test Development Engineer for its Sunnyvale, CA location. In this role, you will define and document manufacturing test strategies, oversee test development, and partner with teams to innovate custom silicon solutions. You...Senior
- ..., and enabling RL training and SOTA LLM and Multimodal inference at scale across multi-GPU and multi-... ...models foroptimalperformance on AMD hardware.Day-0 supports to many SOTA models,... ...like LLVM, MLIR, orROCmis a plus. Heterogeneous System Workloads: Experience running...Senior
- Overview We are now looking for a Senior GPU & Deep Learning Architect to join the NVIDIA GPU Architecture... ...deep learning workloads, design new hardware features, advance parallel computation... ...targeting both training and inference workloads. Advance the state of parallel...Senior
$229.9k - $262.4k
...Senior Lead AI Engineer (FM Hosting, LLM Inference) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for... ...engineering and mathematics, and your expertise in hardware, software, and AI enable you to see and exploit optimization...SeniorFull timePart timeLocal areaCapital One
San Jose, CA18 hours ago$184k - $287.5k
Senior Deep Learning Computer Architect We are now looking for a Senior Deep Learning Computer Architect! NVIDIA... ...seeking architects who can help design hardware accelerator and processor... ...analysis and optimization. Experience with LLM workloads, including performance tuning...Senior- Entrada Ventures is seeking a Principal Hardware Design Engineer to lead the development of innovative hardware solutions at our Santa Clara, CA headquarters. You will play a pivotal role in architecting the physical foundation essential for our silicon-integrated AI accelerators...3 days per week
- ...for a Principal Engineer to enhance performance in AI training and workloads across its hardware and software stack. This role focuses on performance analysis and optimization for LLM workloads running on NVIDIA’s cutting-edge technology. The successful candidate will...
$152k - $241.5k
We are looking for a Senior DL Algorithms Engineer for LLM/Omni model optimizations! Seeking senior engineers... ...to work across all layers of the hardware/software stack from GPU architecture... ...and Cosmos) on NVIDIA’s accelerated inference SW stack. Contribute new features,...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior LLM Inference Architect — Heterogeneous Hardware. Be the first to apply!
Related searches
- senior game producer Santa Clara, CA
- senior electronic design engineer Santa Clara, CA
- senior robotics software engineer Santa Clara, CA
- senior java software engineer Santa Clara, CA
- senior specialist Santa Clara, CA
- senior software test engineer Santa Clara, CA
- sr project engineer Santa Clara, CA
- senior electrical designer Santa Clara, CA
- senior director clinical development Santa Clara, CA
- senior logistics manager Santa Clara, CA