Senior AI Inference Performance Engineer
NVIDIA
NVIDIA seeks a Senior Software Engineer – AI Inference Performance to push LLM/VLM workloads toward practical performance limits on NVIDIA GPUs. You will lead end-to-end analysis, build performance models, and optimize latency, throughput, and energy efficiency across models, serving software, and distributed runtimes. The role spans profiling, tuning, and developing high-performance kernels with CUDA, Triton, and CUTLASS while collaborating with model, kernel, networking, and GPU architecture #J-18808-Ljbffr NVIDIA
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior AI Inference Performance Engineer in Santa Clara, CA vacancy
- CoreWeave is hiring a Senior Engineer for its Benchmarking & Performance team to write, profile, and optimize GPU kernels on the LLM inference path. You will improve latency and throughput and collaborate with product, orchestration, and hardware teams to achieve strict...SeniorPerformance
- NVIDIA is seeking a Senior Agentic AI Software Engineer (Finance) to build agentic systems and advance AI inference workloads in real-world finance contexts. You will design and... ...drives experimental agents, optimize performance, and contribute to cutting-edge AI research...SeniorPerformance
- ...headquartered in Santa Clara, CA, seeks a Principal System Software Engineer for AI Inference Execution. You will join the software team to productize... ...proficiency in C/C++/Python on Linux, and experience with distributed, high-performance software. #J-18808-Ljbffr Jobleads-USSeniorPerformance
$184k - $287.5k
We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency. You’ll architect and implement high-performance inference stacks, optimize GPU kernels and compilers, drive industry...SeniorPerformanceFull time- ...centers, delivering low-latency, high-throughput AI for multi-node GPU workloads. As a Senior Engineer, you will shape core infrastructure and architecture decisions, lead performance optimizations, and own the inference engine to scale research and production workloads...SeniorPerformance
$184k - $287.5k
We are now looking for a Senior DL Algorithms Engineer! NVIDIA is seeking senior engineers... ...who are mindful of performance analysis and optimization... ...technology company that leads the AI revolution.What you will... ...and multimodal model inference as part of NVIDIA...SeniorPerformanceFull time$184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to... ...push every LLM inference operation to its performance ceiling? Our LLM Inference Performance... ...agentic kernel optimization: applying AI-driven analysis to diagnose performance...SeniorPerformanceFull time- ...that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems.... ..., we advance your career. THE ROLE:We are looking for a Senior GPU Inference Performance Engineer to own end-to-end performance analysis of GPU-...SeniorPerformance
$184k - $356.5k
A leading technology company in California is seeking a Senior DL Algorithms Engineer to drive inference performance for Deep Learning workloads. The role involves implementing advanced model inference and collaborating with co-design teams to optimize performance across...SeniorPerformance$193.3k - $261.5k
We are looking for a Senior Inference Engineer to own inference for real-time multimodalconversational AI. This is a full-stack inference role: you will work across the entire... .../latency trade-offs• Develop and tune high-performance kernels for critical operations where off-...SeniorPerformanceInternshipLocal areaFlexible hours$184k - $287.5k
...millions globally. We seek a Senior Engineer to lead technical efforts in deploying advanced AI agent frameworks and local runtimes... .... By combining powerful local inference (Nemotron models) with strong... ..., particularly C++ (for performance-critical systems/OS integration...SeniorPerformanceFull timeLocal areaShift work$152k - $241.5k
...into the unlimited potential of AI to define the next era of... ...world.As a Developer Technology Engineer, you will be at the forefront... ...in suboptimal runtime performance.Conduct hands-on trainings, develop... ...with GPU-accelerated AI inference driven by NVIDIA APIs and SDKs...SeniorPerformanceFull timeLocal area$188k - $275k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by... ...superior infrastructure performance with deep technical expertise... ...What You'll Do: The Field Engineering organization at CoreWeave is... ...that customers can train and inference on at scale, spanning infrastructure...SeniorPerformancePermanent employmentFull timeContract workTemporary workCasual workWork at officeFlexible hoursCoreWeave
Sunnyvale, CA26 days ago$160k - $253k
...are transforming into AI factories, and NVIDIA accelerated... ...computing is the engine of artificial... ...platforms integrate high performance compute, networking, and... .... We are looking for a Senior Technical Marketing Engineer... ...and efficiency for AI inference & training.What you’ll...SeniorPerformanceFull time$240k
...builds the world's largest AI chip, 56 times larger... ...-leading training and inference speeds; over 10 times... ...multiple openings for Senior Quality Assurance... ...integration, regression, and performance test strategies for AI... ...monitoring tools, and engineering best practices....SeniorPerformance$184k - $287.5k
...team to help unlock maximum hardware performance for emerging AI workloads. You will be a crucial... ...performance bottlenecks in both training and inference pipelines.Collaborate closely with... ...in Computer Science, Computer Engineering, Electrical Engineering, or related...SeniorPerformanceFull time- A leader in AI technology in Palo Alto is seeking a Senior AI Systems Performance Engineer to optimize the latest foundation models on their innovative platform. This role involves collaborating with cross-functional teams to push the performance limits of AI systems....SeniorPerformance
$160k - $198k
...our team members.What You’ll DoAs a Senior AI Systems Engineer, you will architect, deploy, and manage... ...large-scale AI model training and inference. You will ensure our machine... ...bridging the gap between raw data and high-performance AI models.Infrastructure & Orchestration...SeniorPerformanceLocal area$272k - $431.25k
...NVIDIA is the engine of modern AI, and robotics is where AI meets the physical world. The Isaac... ...team. Recruit, grow, and mentor a high-performing team of robotics software engineers; set... ...simulation, training, and on-robot inference on Jetson and edge platforms.Deliver....SeniorPerformanceFull time$124.5k - $272k
...networking for the cloud and AI era. We secure and... ..., its Zero Trust Engine, and the powerful NewEdge... ...visibility and control without performance trade-offs.At Netskope,... ...are available at Senior Staff and above. Candidates... ...Scientist, you own the inference and optimization layer...SeniorPerformance- ...Role :- Senior Site Reliability Engineer Location :- Santa Clara, CA(Onsite)... ...will provide SRE services for AI platforms and supporting infrastructure... .... Troubleshoot performance and availability issues affecting training jobs, inference services, internal...SeniorPerformanceTemporary work
Noblesoft Technologies
Santa Clara, CA1 day ago $184k - $287.5k
...architect that wants to change how the AI inference industry works. With agent adoption taking... ...SA support to push the boundaries of performance, squeezing value and reliability out of... ...C-level executives, distinguished engineers and datacenter developers how to scale...SeniorPerformanceFull time- NVIDIA in Santa Clara, CA, seeks a senior product leader to own the inference performance roadmap, shaping how models are represented, memory/state is managed, and tokens are generated. You will build scalable platforms across model families and deployment topologies for...SeniorPerformance
$168k - $258.75k
Inference is the fastest growing and most competitive area in Generative AI today. It is where AI models impact our... ...bit of accuracy and performance matters for quality,... ...deployment techniques. As a Senior Product Manager for... ...Science, Computer Engineering, or similar...SeniorPerformanceFull time- NVIDIA is seeking a Senior Product Manager for AI Inference Performance (Finance) to own optimization strategies across the inference stack and drive platform capabilities for diverse deployments. You will translate deep optimization into broadly adoptable products, collaborate...SeniorPerformance
$201.3k - $352.3k
...DescriptionIt all started when engineer Fred Luddy wrote code that... ...work. Today, ServiceNow is the AI control tower for business... ...infrastructure — prioritizing robustness, performance, safety, and real-world... ...to LLM fine-tuning or inference optimization in production.Why...SeniorPerformanceWork experience placementWork at officeImmediate startRemote workFlexible hours- ...developer of Embodied AI technology. Our advanced... ...feedback on driving performance. Key Responsibilities... ...well as machine learning inference on the edge. Fault... ...Product, Project, and Engineering management to advise and... ...up for success as a Senior Software Engineer at Wayve...SeniorPerformance
- Lead the end-to-end performance analysis and optimization of LLM and VLM inference on NVIDIA GPU-accelerated systems. Develop performance... ...to open-source inference engines to reduce latency and increase... ...of experience in full-stack AI inference performance with strong...SeniorPerformance
- NVIDIA is seeking a highly technical Product Manager to own AI inference optimization on NVIDIA hardware, from single-GPU workstations... ..., release readiness, and cross-functional collaboration to deliver measurable performance gains and compelling #J-18808-Ljbffr NVIDIASeniorPerformance
- NVIDIA seeks a Product Manager for Inference to enable developers to deploy high-performance AI on NVIDIA GPUs. You will shape product strategy, roadmaps, and go-to-market plans, collaborating with internal teams and external developers to build model-optimization software...SeniorPerformance
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference Performance Engineer. Be the first to apply!
Related searches
- ai prompt engineer Santa Clara, CA
- senior ai engineer Santa Clara, CA
- ai developer Santa Clara, CA
- ai engineer Santa Clara, CA
- ai engineer remote Santa Clara, CA
- senior network engineer remote Santa Clara, CA
- senior app developer Santa Clara, CA
- senior manager legal Santa Clara, CA
- sr project manager Santa Clara, CA
- senior account executive Santa Clara, CA