Senior LLM Serving Performance Co-Design Engineer
Google Inc.
Google Cloud’s mission is to make every business successful through AI by combining cutting-edge technology, infrastructure, and talent. The TPU Chip Architecture and Performance Co-design team optimizes Google's custom AI silicon for next-generation ML models, including LLMs, on our own hardware. As a Senior Performance Co-design Engineer, you will focus on LLM Serving Studies, analyzing and optimizing serving performance on our custom hardware, and collaborating with hardware architects to #J-18808-Ljbffr Google Inc.
Vacancy posted 23 hours ago
Similar jobs that could be interesting for youBased on the Senior LLM Serving Performance Co-Design Engineer in Sunnyvale, CA vacancy
- Google Cloud’s TPU Chip Architecture and Performance Co-design team seeks a Senior Performance Co-Design Engineer to drive LLM serving studies and optimize serving performance on our custom AI silicon. You’ll partner with researchers and hardware teams to balance latency...SeniorPerformance
- Google Cloud is seeking a Senior Performance Co-Design Engineer for TPU work in Sunnyvale to optimize serving performance of large language models on custom AI silicon. You will... ...and software partners. The role centers on LLM inference latency and throughput,...SeniorPerformance
$174k - $252k
...Science, Electrical Engineering, Computer... ...of experience in performance modeling/engineering... ...computer architecture, co-design, or systems engineering... ...inference/serving optimizations. Familiarity... ...models. As a Senior Performance Co-Design... ...focus and conduct LLM Serving Studies....SeniorPerformanceWorldwide$174k - $252k
Senior Performance Co-design Engineer, LLM Training Google, Sunnyvale, CA, USA Mid Experience driving progress, solving problems, and mentoring more junior... ...a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal...SeniorPerformanceWorldwide$174k - $252k
Lead hardware/software co-design and performance modeling for LLM training workloads across current and future... ...degree in Computer Science, Electrical Engineering, Computer Engineering, or a... ...generation machine learning models. As a Senior Performance Engineer, you will...SeniorPerformanceWorldwide- Google Sunnyvale is seeking a Senior Performance Co-design Engineer for LLM training to shape future ML accelerators and ensure efficient training across current and future silicon. You will lead hardware/software co-design and performance modeling, collaborating with ML...SeniorPerformance
- Google Sunnyvale is seeking a Senior Performance Co-design Engineer focused on LLM training to drive the hardware-software co-design for next-gen ML accelerators. You will lead modeling, analyze bottlenecks, and partner with ML researchers to optimize training workloads...SeniorPerformance
- Google Cloud’s TPU Chip Architecture and Performance Co-design team seeks a Senior Performance Engineer in Sunnyvale to optimize AI silicon for large language model training. You will study training workloads for 1P and 3P models, shaping hardware and software architectures...SeniorPerformance
$168k - $264.5k
...shipment. NVIDIA's Silicon Co-Design Group sits at the convergence... ...: escapes, yield loss, and performance loss.We're hiring a Senior Manufacturing & System Co-Design Workflow Engineer to lead the methodology and... ...are today depending on an LLM-backed tool you built.Deep...SeniorPerformanceFull timeImmediate start$196k - $310.5k
...NVIDIA is seeking an outstanding Platform Design Engineer to join our Circuit Solutions Group... ...product to manufacturing and partners, and serve as the primary interface to the Silicon... ...and ensure the design meets the performance and testing requirements.Hands-on development...SeniorPerformanceFull time$192k - $278k
...hardware/software stack to enable performant training and serving of large ML models.... ...with partners across hardware design, compiler development, and... ...'s degree in Electrical Engineering, Computer Engineering, Computer... ..., or hardware-software co-design.Experience developing...PerformanceWorldwide$210.87k - $329.86k
...high-impact, visionary Senior Principal AI Engineer to architect, design, and oversee the next generation... ...-Tuned Enterprise LLM," transforming massive,... ...visibilitytechnology role. You will serve as the lead and... ...analysis of board performance. This system enables engineering...SeniorPerformanceTemporary workWork at officeLocal areaWorldwideShift work$161.55k - $317.6k
...Manufacturing Development Customer Engineering (MDCE) is Intel's newest... ...to launch HVM operations serving global foundry customers.... ...: We seek an experienced Senior Staff Collateral Design and DFM Engineer to join... ...improvements in performance, yield, and ramp speed across...SeniorPerformanceFull timeInternshipLocal areaImmediate startShift work$184k - $287.5k
We are now looking for a Senior Deep Learning Architect, LLM Inference!NVIDIA is at the... ...on inference server performance optimization for Large Language... ...terms like disaggregated serving, data parallel attention,... ....Collaborate with engineers from AI startup companies...SeniorPerformanceFull time$152k - $241.5k
...NVIDIA’s TensorRT Edge-LLM team and help shape... ...autoregressive model serving capabilities, including... ...and KV cache management.Design and implement compiler... ...robotics to deliver high-performance, production-ready... ..., Electrical/Computer Engineering, or a closely related...SeniorPerformanceFull time$174.72k - $295.68k
...build strong foundation for LLM deployment and quality sign-off... ...research team to establish performance estimates and prove model feasibility... ...QAT orchestration workflows.Serve as the primary interface with... ...programming and software engineering skills.Ability to work...SeniorPerformanceFull time- ...what’s possible with LLM inference on heterogeneous... ...applied research and engineering team that moves fast,... ...-grade inference serving.This RoleWe are hiring... ...architectures and how to squeeze performance out of them at... ...real hardware.• Small, senior team with high autonomy...SeniorPerformance
$136k - $218.5k
...sits at the crossroads of design, architecture,... ...Verification CoDesign Engineer, you will work on system... ...and operations teams to co-design system-level speed... ...across testing flows. Perform closed loop validation... ...modeling; apply AI and LLM-assisted workflows (e.g...PerformanceFull time$240k - $334k
TPU Co-Design Engineer, Google Cloud Google Sunnyvale, CA, USA Advanced Experience... ...developing systems for performance modeling, simulation, or... ...AI/ML-driven systems. As a Senior Staff Co-Design Engineer on... ...machine learning training and serving capabilities. You will advocate...PerformanceWorldwideShift work$136k - $218.5k
...group delivers innovative PHY designs that power the most powerful... ...channels, supporting NVIDIA's high-performance interconnect protocols:... ...networking and enabling the era of Co-Packaged Optics (CPO) for... ...or M.S. degree in Electrical Engineering or equivalent experience.5+...SeniorPerformanceFull time$136k - $218.5k
The SCG Architecture team is hiring a Senior Power Integrity Co-Design Engineer to architect and deliver di/dt mitigation across silicon, package, board, and platform. This role bridges architecture, silicon, and platform — translating product noise targets into shipped...SeniorFull timeLive in$168k - $264.5k
NVIDIA is seeking ASIC Design Engineers with experience in agentic AI to help design and implement... ...will help the ASIC team implement high performance, area and power efficient RTL to... ...Drive impact by designing and deploying LLM-powered solutions for engineering assistants...SeniorPerformanceFull timeWork experience placement$168k - $258.75k
...looking for a Datacenter Product Engineer! NVIDIA Corporation is a... ...which the company invented, serves as the visual cortex of modern... ...networking. With its end-to-end performance and flexibility, NVIDIA HGX... ...GPU and/or CPU development, design, system architecture, as well...SeniorPerformanceFull timeWorldwide$272k - $431.25k
...framework for serving generative AI and... ...in Rust for performance and Python for... ...of cutting-edge LLM workloads.We are... ...Principal Systems Engineer to define the... ...you'll be doing:Design and evolve a... ...disaggregated clusters.Co-design... ...memory pools.Mentor senior and junior...PerformanceFull timeLocal areaRemote work$163k - $236k
...from HLS code to generated RTL.Design and maintain advanced... ...specific methods such as C/RTL co-simulation, formal equivalence... ...verifiability and mentor junior engineers on the nuances of HLS verification... ..., delivering unparalleled performance, efficiency, and integration....SeniorPerformanceWorldwide$136k - $218.5k
NVIDIA is seeking a hardworking Senior ASIC Design Verification Engineer to help drive sign-off strategies for... ...outstanding opportunity to influence performance of the next generation GPU and SoC,... ...knowledge or work experience in co-simulation environments such as VCS...SeniorPerformanceFull timeWork experience placementRemote work$184k - $287.5k
...are now looking for a Senior DL Algorithms Engineer! NVIDIA is seeking... ...engineers who are mindful of performance analysis and... ...production code to TRT-LLM, NVIDIA’s open-source inference serving library.Profile and analyze... ...with other SW/HW co-design teams to enable the...SeniorPerformanceFull time$272k - $431.25k
...NVIDIA is seeking a Principal Engineer to drive the performance of large-scale AI training... ...optimize frontier-scale LLM workloads running on thousands... ...architecture decisions.Serve as a technical authority for... ...runtimes, or hardware/software co-design.Deep hands-on experience...PerformanceFull time$164.47k - $311.89k
...Description: About the RoleIntel is seeking a Senior Design Verification Engineer for the Silicon Chassis team. In... ...signoffs and achievement of performance and power metricsLead IP delivery to... ...methodologies including UVM, SVA, ABV, and co-simulation; proficiency in low-power...SeniorPerformanceFull timeInternshipLocal areaImmediate startShift work- ...learning machines. We lead in chip design, verification, and IP... ...empowering the creation of high-performance silicon chips and software... ...experienced and highly motivated engineer with a passion for... ...for new features and products, serving as "executable specifications...SeniorPerformance
Synopsys Inc
Sunnyvale, CAmore than 2 months ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior LLM Serving Performance Co-Design Engineer. Be the first to apply!
Related searches
- data center design engineer Sunnyvale, CA
- rtl design engineer Sunnyvale, CA
- cad design engineer solidworks Sunnyvale, CA
- new product engineer Sunnyvale, CA
- senior asic design engineer Sunnyvale, CA
- product engineer Sunnyvale, CA
- soc design engineer Sunnyvale, CA
- senior manager product engineering Sunnyvale, CA
- ic design engineer Sunnyvale, CA
- sr. product engineer Sunnyvale, CA