Engineering Manager: LLM/VLM Inference Performance
NVIDIA
NVIDIA is seeking an Engineering Manager focused on advancing LLM and VLM inference software technologies. This high-impact role combines hands-on leadership with technical expertise, requiring collaboration with various teams to deliver high-performance software. Ideal candidates should possess a master's or PhD in a related field, strong experience in software engineering leadership, and proficiency in C++ or Python. The position offers a competitive salary range based on level and location, as well as equity and benefits. #J-18808-Ljbffr NVIDIA
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Engineering Manager: LLM/VLM Inference Performance in Santa Clara, CA vacancy
$224k - $356.5k
...AIPerf, is the growing standard for assessing LLM serving performance across various inference frameworks. Hyperscalers, cloud providers,... ...improving efficiency, and scaling. As Technical Lead Manager, you will lead the engineering team within NVIDIA’s Dynamo organization. You...PerformanceLocal areaWorldwide$262k - $365k
...hardware. 5 years of experience directly managing and leading engineering teams focused on machine learning infrastructure, AI platforms, or high-performance distributed computing systems. 5... ...of experience implementing advanced LLM serving architectures and optimization...Performance$224k - $356.5k
...power AI training and inference for customers around the... ...thoughtful, creative engineers who care about doing... ...looking for an Engineering Manager to lead the team that... ...coding assistants and LLM-based tools to improve... ...Intelligence, High-Performance Computing and Visualization...PerformanceRemote work$206k - $303k
...leading AI labs with the most performant, efficient and resilient... ...We’re seeking a Principal Engineer to serve as the hands-on technical... ...leader for our next-generation Inference Platform . As a senior... ...frameworks (Triton, vLLM, TensorRT-LLM, Ray Serve, TorchServe) and...PerformancePermanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift work- ScOp Venture Capital is looking for an ML Systems Engineer to optimize LLM inference systems crucial for their AI platform. The role focuses on enhancing performance and efficiency via low-level systems optimization, directly impacting industry leader processes in semiconductor...Performance
- NVIDIA Gruppe is looking for a skilled engineer to join their TensorRT Edge-LLM team in Santa Clara, California.... ...developing a state-of-the-art inference framework for large language models and optimizing it for real-time performance on embedded platforms. Candidates...Performance
- NVIDIA is seeking a Senior Inference Engineer in Santa Clara, CA to advance AIConfigurator, optimizing... ...configurations for large-scale LLM inference on NVIDIA platforms. This role... ...enhancing software for better GPU and model performance. The ideal candidate will have a degree...Performance
$192.6k - $289k
...Technologies, Inc. Job Area Engineering Group, Engineering... ..., generative AI inference and Agentic AI workloads... ...accessibility and performance of a datacenter inference... ...for Generative AI (LLM, VLM, VLA), Agentic AI,... ...customers, partners, product management, customer engineering...PerformanceWork experience placementWork from home- Ampere, a semiconductor design company, is seeking an AI Accelerator Software Principal Engineer - NPU Full‑Stack Integration to lead high‑performance inference on Arm Ethos-U85. You will optimize AI software from model execution to kernel performance, working across compiler...Performance
$298k - $368k
...diverse set of sensors, enabling engineers like you to (1) develop... ...hardware. You will Design VLM/LLM model architecture and drive... ...architectures. Optimize model performance for on-device use cases (... ...expertise in low-latency on-device inference techniques and a deep...PerformanceFull timeRemote work- ...is looking for a Principal Software Engineer to join their Managed AI team. You will play a key role in... ...architecture and scalability of an AI inference platform, leading the design of core... ...for AI services and optimizing performance. This position requires expertise in...Performance
- ...them. Because AI training and inference demand flawless, low-latency... ..., Nokia is where engineers solve the actual capacity and... ...oriented Engineering Project Manager (EPM) to drive development and... ...functional efforts to deliver high-performance PICs to power the world's...PerformanceShift work
$270k - $300k
...you will be part of a high‑performing team that is redefining what... ...at Quince. The Role Senior Engineering Manager, MLOps We are seeking a Senior... ...and infrastructure cost per inference. Champion Operational... ...Monitor emerging trends in LLM‑ops, vector databases, and real...PerformanceSeasonal workLocal area- ...Overview Job Description As the Engineering Manager for the Machine Learning... ...end systems for the entire ML/LLM lifecycle. This includes our... ...distributed training and inference, model evaluation frameworks... ...Drive the Strategy for model performance and efficiency, making critical...PerformanceWork at officeRemote workFlexible hours
ServiceNow
Mountain View, CA16 hours ago $272k - $425.5k
A leading technology firm in Santa Clara seeks a Principal Software Engineer for Large-Scale LLM Memory and Storage Systems. The role involves designing a unified memory layer for large-scale inference, integrating with LLM serving engines, and mentoring engineers. Candidates...Remote job- ...As an Applied ML Validation Manager on the Software Validation team... ...release, and long-term performance monitoring. About the Organization... ...Learning, Robotics, Software Engineering, Data Science , or a related... ...-based validation, including VLM critics , human benchmarking,...Performance
$206k - $333k
...combines superior infrastructure performance with deep technical expertise... ...'re looking for a Principal Engineer to be the technical lead of... ...publications: If MLPerf (Training & Inference), Working closely with NVIDIA (Megatron-LM, TensorRT-LLM & DGX cloud) and the open-...PerformancePermanent employmentTemporary workCasual workWork at officeFlexible hoursCoreWeave
Sunnyvale, CA26 days ago$141.8k - $258.6k
...team is seeking a Technical Program Manager to help shape the future of... ...cross‑functional coordination across engineering teams to deliver robust, high‑performance ML systems that operate across... ...performance distributed computing, or inference optimization technologies....PerformanceRelocation$300 per month
...and be part of a high‑performing team that believes in... ...The Principal Software Engineer for the Model LifeCycle... ...a comprehensive managed platform for the entire... ...with the open‑source LLM ecosystem. This role... ..., including training, inference. Bonus Points Proficiency...PerformanceTemporary work$272k - $431.25k
...R&D group requires a senior software engineer. In this exciting role, you will profile... ...used for distributed Deep Learning LLM training and inference. Your primary focus will be... ...libraries. Moreover, you will build performance analysis tools and strategies to investigate...Performance- ...9% accuracy. About the Role We're seeking an experienced LLM Inference Engineer to optimize our large language model (LLM) serving infrastructure... ...phases Continuously benchmark and improve system performance across various deployment scenarios and GPU types What You...Performance
$245k - $325k
...disrupting the AI and high-performance computing space with an integrated... ...platform. Our SambaStack inference serving platform is pushing... ...is hiring a Software Engineering Manager for the SambaStack platform.... ...infrastructure challenges of LLM workloads at production scale...PerformanceFull timeTemporary workLocal areaFlexible hoursSambaNova Systems
San Jose, CA16 hours ago- ...large language model inference? Join NVIDIA’s TensorRT Edge‑LLM team and help... ...and Multimodal (LLM/VLM/VLA) models to run... ...MoE, and KV cache management. Design and implement... ...to deliver high‑performance, production‑ready... ...Electrical/Computer Engineering, or a closely...Performance
$182k - $273k
Ampere is seeking an AI Accelerator Software Principal Engineer to design and integrate high-performance deep learning solutions. You'll collaborate with a diverse team to enhance AI capabilities across both data center and edge environments. The ideal candidate has extensive...Performance$241.8k - $409.2k
...Software Architect/ Principal Engineer XPENG is a leading smart... ...at least 1.3 times the performance of existing solutions on... ...Engine, virtual memory management, CUDA dynamic CUTLASS 3.... ...includes MLPerf Inference, Stable Diffusion XL, and 70B LLM Cross-functional Collaboration...PerformanceFull time$250k - $300k
...with confidence. We’re hiring a strong engineering leader to own the Cloud & Platform engineering... ...hands-on Tech Lead ready to step into management OR a Manager who still codes and... ...scale Drive improvements in reliability, performance, and scalability Lead and mentor...PerformanceWork at officeShift workOrkes Inc.
Santa Clara, CA15 hours ago- ...GPU compute to AI model inference API solutions. As an... ...highest standards for performance, security, and scalability... ...Machine Learning Engineers to make GMI the new industry benchmark for LLM serving performance, cost... ..., KV cache and memory management, prefill/decode...PerformanceWorldwide
$245k - $325k
...Director, Software Engineering SambaNova Systems... ...Software Engineering Manager for the SambaStack platform... ...providers host their own AI inference platforms, powered by... ...you will lead a high-performing team of engineers... ...infrastructure challenges of LLM workloads at...PerformanceFull timeTemporary workLocal areaFlexible hoursSoftbank Investment Advisers
San Jose, CA2 days ago- ...transformation. About the Role We are seeking an Engineering Manager who will manage the R&D engineering... ...We scout new capabilities — a frontier LLM that can chain tool calls, browser... ..., technical excellence, and a high-performing culture that can move from 0 to 1 and sustain...PerformanceImmediate startShift work
COMMURE Incorporated
Mountain View, CA17 days ago $45 per hour
...software and d... Full-time We are looking for an experienced engineering manager to join its talented and growing Haptics team. This person... ..., then look no further. Skyworks is an innovator of high-performance analog semiconductors whose solutions are powe... Full-time...PerformanceHourly payFull timeInternshipWork at officeLocal areaMonday to FridayNR Consulting
Cupertino, CA15 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Engineering Manager: LLM/VLM Inference Performance. Be the first to apply!
Related searches
- performance manager Santa Clara, CA
- application performance engineer Santa Clara, CA
- acting performance Santa Clara, CA
- performance test architect Santa Clara, CA
- lead performance test engineer Santa Clara, CA
- performance test engineer Santa Clara, CA
- performance engineer Santa Clara, CA
- senior performance engineer Santa Clara, CA
- senior performance tester Santa Clara, CA
- sports performance Santa Clara, CA