Senior LLM Serving Performance Co-Design Engineer
Google Inc.
Google Cloud’s mission is to make every business successful through AI by combining cutting-edge technology, infrastructure, and talent. The TPU Chip Architecture and Performance Co-design team optimizes Google's custom AI silicon for next-generation ML models, including LLMs, on our own hardware. As a Senior Performance Co-design Engineer, you will focus on LLM Serving Studies, analyzing and optimizing serving performance on our custom hardware, and collaborating with hardware architects to #J-18808-Ljbffr Google Inc.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior LLM Serving Performance Co-Design Engineer in Sunnyvale, CA vacancy
- Google Cloud is seeking a Senior Performance Co-Design Engineer for TPU work in Sunnyvale to optimize serving performance of large language models on custom AI silicon. You will... ...and software partners. The role centers on LLM inference latency and throughput,...SeniorPerformance
$174k - $252k
Senior Performance Co-Design Engineer, TPU Company: Google Location: Sunnyvale, CA, USA Mid Experience driving... ...tools, or deep learning inference/serving optimizations. Familiarity with accelerator... ..., you will focus and conduct LLM Serving Studies. In this role, you...SeniorPerformanceWorldwide$196k - $310.5k
...NVIDIA is seeking an outstanding Platform Design Engineer to join our Circuit Solutions Group... ...product to manufacturing and partners, and serve as the primary interface to the Silicon... ...and ensure the design meets the performance and testing requirements.Hands-on development...SeniorPerformanceFull time$192k - $278k
...hardware/software stack to enable performant training and serving of large ML models.... ...with partners across hardware design, compiler development, and... ...'s degree in Electrical Engineering, Computer Engineering, Computer... ..., or hardware-software co-design.Experience developing...PerformanceWorldwide$210.87k - $329.86k
...high-impact, visionary Senior Principal AI Engineer to architect, design, and oversee the next generation... ...-Tuned Enterprise LLM," transforming massive,... ...visibilitytechnology role. You will serve as the lead and... ...analysis of board performance. This system enables engineering...SeniorPerformanceTemporary workWork at officeLocal areaWorldwideShift work- Google Sunnyvale, CA invites a Senior Staff Performance Codesign Engineer to shape TPU hardware and software for world-class AI/ML workloads. You will drive architecture decisions, verify complex digital designs, and align research with production systems powering billions...SeniorPerformance
$184k - $287.5k
We are now looking for a Senior Deep Learning Architect, LLM Inference!NVIDIA is at the... ...on inference server performance optimization for Large Language... ...terms like disaggregated serving, data parallel attention,... ....Collaborate with engineers from AI startup companies...SeniorPerformanceFull time$174.72k - $295.68k
...build strong foundation for LLM deployment and quality sign-off... ...research team to establish performance estimates and prove model feasibility... ...QAT orchestration workflows.Serve as the primary interface with... ...programming and software engineering skills.Ability to work...SeniorPerformanceFull time- ...extends TensorRT with autoregressive model serving capabilities. Collaborate with teams... ...compilers, and robotics to deliver high-performance, production-ready solutions. Requirements... ...are essential. Key Skills C++, TensorRT, LLM, VLM, GEMM, CUDA, Attention, MoE, KV Cache...SeniorPerformance
- ...what’s possible with LLM inference on heterogeneous... ...applied research and engineering team that moves fast,... ...-grade inference serving.This RoleWe are hiring... ...architectures and how to squeeze performance out of them at... ...real hardware.• Small, senior team with high autonomy...SeniorPerformance
$136k - $218.5k
...sits at the crossroads of design, architecture,... ...Verification CoDesign Engineer, you will work on system... ...and operations teams to co-design system-level speed... ...across testing flows. Perform closed loop validation... ...modeling; apply AI and LLM-assisted workflows (e.g...PerformanceFull time$184k - $287.5k
...shipment. NVIDIA's Silicon Co-Design Group sits at the convergence... ...: escapes, yield loss, and performance loss.We're hiring a Senior Manufacturing & System Co-Design Workflow Engineer to lead the methodology and... ...are today depending on an LLM-backed tool you built.Deep...SeniorPerformanceFull timeImmediate start$136k - $218.5k
...group delivers innovative PHY designs that power the most powerful... ...channels, supporting NVIDIA's high-performance interconnect protocols:... ...networking and enabling the era of Co-Packaged Optics (CPO) for... ...or M.S. degree in Electrical Engineering or equivalent experience.5+...SeniorPerformanceFull time$136k - $218.5k
The SCG Architecture team is hiring a Senior Power Integrity Co-Design Engineer to architect and deliver di/dt mitigation across silicon, package, board, and platform. This role bridges architecture, silicon, and platform — translating product noise targets into shipped...SeniorFull timeLive in$168k - $264.5k
NVIDIA is seeking ASIC Design Engineers with experience in agentic AI to help design and implement... ...will help the ASIC team implement high performance, area and power efficient RTL to... ...Drive impact by designing and deploying LLM-powered solutions for engineering assistants...SeniorPerformanceFull timeWork experience placement$168k - $258.75k
...looking for a Datacenter Product Engineer! NVIDIA Corporation is a... ...which the company invented, serves as the visual cortex of modern... ...networking. With its end-to-end performance and flexibility, NVIDIA HGX... ...GPU and/or CPU development, design, system architecture, as well...SeniorPerformanceFull timeWorldwide$175k - $265k
...possibilities of AI. Role OverviewAs Sr. Staff PCB Design Engineer, you will lead the physical design of... ...loss. Beyond hands-on layout, you will serve as custodian of our Design Methodology,... ...based on individual and company performance. This is in addition to our diverse...SeniorPerformance$272k - $431.25k
...framework for serving generative AI and... ...in Rust for performance and Python for... ...of cutting-edge LLM workloads.We are... ...Principal Systems Engineer to define the... ...you'll be doing:Design and evolve a... ...disaggregated clusters.Co-design... ...memory pools.Mentor senior and junior...PerformanceFull timeLocal areaRemote work$184k - $287.5k
...are now looking for a Senior DL Algorithms Engineer! NVIDIA is seeking... ...engineers who are mindful of performance analysis and... ...production code to TRT-LLM, NVIDIA’s open-source inference serving library.Profile and analyze... ...with other SW/HW co-design teams to enable the...SeniorPerformanceFull time$163k - $236k
...from HLS code to generated RTL.Design and maintain advanced... ...specific methods such as C/RTL co-simulation, formal equivalence... ...verifiability and mentor junior engineers on the nuances of HLS verification... ..., delivering unparalleled performance, efficiency, and integration....SeniorPerformanceWorldwide$136k - $218.5k
NVIDIA is seeking a hardworking Senior ASIC Design Verification Engineer to help drive sign-off strategies for... ...outstanding opportunity to influence performance of the next generation GPU and SoC,... ...knowledge or work experience in co-simulation environments such as VCS...SeniorPerformanceFull timeWork experience placementRemote work$272k - $431.25k
...NVIDIA is seeking a Principal Engineer to drive the performance of large-scale AI training... ...optimize frontier-scale LLM workloads running on thousands... ...architecture decisions.Serve as a technical authority for... ...runtimes, or hardware/software co-design.Deep hands-on experience...PerformanceFull time$164.47k - $311.89k
...Description: About the RoleIntel is seeking a Senior Design Verification Engineer for the Silicon Chassis team. In... ...signoffs and achievement of performance and power metricsLead IP delivery to... ...methodologies including UVM, SVA, ABV, and co-simulation; proficiency in low-power...SeniorPerformanceFull timeInternshipLocal areaImmediate startShift work- NVIDIA Gruppe is seeking a Senior Manufacturing & System Co-Design Workflow Engineer to lead the methodology and infrastructure that maintains holistic, systematic alignment, at scale across the full portfolio. You’ll design the workflow before fixing a program and build...Senior
$152k - $241.5k
...are now looking for a Senior Performance Architect for... ...model-system-hardware co-design. We are looking for a... ...architects, and software engineers.What we need to see:A... ...parallelism and inference serving techniques.... ...frameworks like PyTorch, TRT-LLM, VLLM, SGLangA Growth...SeniorPerformanceFull time$208k - $327.75k
...-the-art AI, high-performance compute, and scalable... ...are looking for a Senior AI Architect to... ...how those models co-evolve with NVIDIA... ...hardware-software co-design across next-... ...Science, Electrical Engineering, Machine Learning,... ...Triton, or TensorRT-LLM.Experience influencing...SeniorPerformanceFull timeWorldwide$224k - $356.5k
...hardware-software co-design, and communication... ...interconnects.The Senior Architect role is... ...research and production engineering!What you will be... ...implementing high-performance communication and... ...into AI serving stacks such as vLLM... ...SGLang, TensorRT-LLM) and their communication...SeniorPerformanceFull time$184k - $287.5k
...Optimizing communication performance: Identify and... ...and inference.Designing efficient communication... ...and software co-craft: Collaborate... ...(CS), Electrical Engineering (EE), Computer Science... ..., and optimizing LLM training and inference... ...of the emerging serving architectures like...SeniorPerformanceFull timeWork experience placement$184k - $287.5k
...outstanding AI systems engineers to develop... ...architecture. This means designing and building... ...implementations, new LLM inference runtimes... ...for LLM serving enginesBuilding efficient... ...kernel development and performance optimizations (... ..., TX, Remote; US, CO, Remote; US, WA, Remote...SeniorPerformanceFull timeRemote work$184k - $287.5k
...and strategic Senior Developer Relations... ...'ll Be Doing: Serve as the trusted... ..., fostering co-innovation and... ...solution architects, engineering, product... ...domain-specific LLM, etc. Proven experience... ...in high-performance and accelerated... ...architectural design, code reviews,...SeniorPerformanceFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior LLM Serving Performance Co-Design Engineer. Be the first to apply!
Related searches
- senior physical design engineer Sunnyvale, CA
- product engineer Sunnyvale, CA
- cad design engineer solidworks Sunnyvale, CA
- rtl design engineer Sunnyvale, CA
- sr. product engineer Sunnyvale, CA
- senior product design engineer Sunnyvale, CA
- physical design engineer Sunnyvale, CA
- asic digital design engineer Sunnyvale, CA
- design verification engineer Sunnyvale, CA
- manufacturing design engineer Sunnyvale, CA