Senior Staff AI Inference Systems Engineer — GPU/Performance
$198k - $326kA prominent tech company in Mountain View is looking for a Sr. Staff Software Engineer in Systems Infrastructure to lead optimizations across AI inference systems. Candidates should have 8+ years of experience in software engineering, extensive knowledge of ML systems, and proficiency in Python or C++. The role requires technical leadership and innovative problem-solving to enhance performance and efficiency. This hybrid position offers a competitive salary between $198,000 and $326,000, depending on experience and location. #J-18808-Ljbffr LinkedIn
- AMD is seeking a senior software engineer who blends deep systems performance work with AI, spanning GPU kernels to distributed training and inference. You’ll influence ROCm and AMD’s AI software strategy while mentoring others and tackling high-impact problems on AMD GPUs...SeniorPerformance
- We are looking for a Senior System Software Engineer to work on Dynamo-Triton Inference Server. NVIDIA is hiring... ...software engineers for its GPU-accelerated deep... ...power a revolution in AI, enabling breakthroughs... ...team building a highly‑performant AI inference platform to...SeniorPerformance
- ...an experienced professional to optimize AI workloads at DGX Station (Galaxy) in... ...readiness of AI applications, profiling multi-GPU environments, and collaborating to... ...candidate has over 12 years of experience in systems software engineering and strong expertise with deep learning...SeniorPerformance
- NVIDIA is seeking an experienced Senior System Engineer to work on GPU rack platforms. This role involves integration, validation, and troubleshooting ensuring... ...centers. Key responsibilities include collaborating on AI server designs, debugging early prototypes, and...Senior
- Clockwork Systems, Inc. is seeking an experienced Systems Engineer to design and implement high-performance distributed GPU training systems. This role involves working with GPU clusters, high-speed networking, and ensuring fault tolerance in complex systems. Ideal candidates...SeniorPerformance
- ...in California is seeking a skilled engineer to optimize deep learning frameworks... ...for AMD GPUs. This role will enhance performance across multi-GPU systems, focus on GPU kernel development, and... ...C++, Triton, and experience with AI frameworks like PyTorch and SGLang....SeniorPerformanceFull time
- NVIDIA is seeking a Senior Systems Software Engineer to improve performance, reliability, and scalability of a system routing AI workloads across distributed GPU fleets. You’ll work on a polyglot platform with open source components, contributing to control plane and edge...SeniorPerformance
$184k - $356k
Nvidia Corporation is seeking a Senior Inference Engineer to advance AIConfigurator, optimizing deployment configurations for large-scale LLM... ...and collaborating with multiple teams to improve deployment performance. The ideal candidate has a PhD or equivalent experience, 1...SeniorPerformance$178.7k - $268.1k
...love. Our Vector Gamer AI team sits at the heart... .... We’re hiring a Senior Backend Engineer to build and operate the... ...operate the distributed systems that power billions of... ..., with a focus on the performance, reliability, and scalability of inference systems. What You’ll...SeniorPerformanceWork at officeRelocation package$216k - $414k
...into the unlimited potential of AI to define the next era of... ...architect with experience in high-performance networking technologies, DPUs... ...: Enhance NVIDIA's future GPU Networking offerings for... ...engage a globally distributed engineering team Eagerness to learn new technologies...SeniorPerformance$184k - $287.5k
We are seeking software engineers to work on next-generation graphics... ...demanding applications a GPU or high-performance computing server will encounter... ..., a solid foundation of systems software with emphasis on OS... ...existing vacancy. NVIDIA uses AI tools in its recruiting...SeniorPerformance- ...Member of Technical Staff — CI Engineer to improve CI reliability... ...open-source LLM inference engine. The role requires... ...of Linux and GPU computing, as well as... ...building world-class AI infrastructure, ensuring fast and secure system performance. This is an opportunity...SeniorPerformance
- ...’re looking for a Senior Engineer to help build the next-generation inference platform that supports... ..., retrieval, and AI-native experiences... ...on building core systems and services that... ...for reliability, performance, and ease of use.... ...performance, autoscaling, GPU utilization, and...SeniorPerformance
- Tensordyne is seeking a Hardware Design Engineer in Sunnyvale, CA, to lead hardware system development. This role offers the chance to own critical aspects... ..., PCB layout, and mechanical design, ensuring high-performance AI products. You will collaborate closely with ASIC,...SeniorPerformance
- Senior Solution Architect - AI / GPU Cloud We are seeking a Senior Solution... ...partner closely with engineering and operations... ...compute to AI model inference API solutions. As an... ...highest standards for performance, security, and... ...cluster/orchestration systems, NVIDIA GPU stack (...SeniorPerformance
- ...looking for a motivated Deep Learning engineer in Santa Clara, California, to advance communication technologies in AI environments. This role focuses on... ...into AI frameworks, aiming to enhance performance and scalability in multi-GPU computing. The ideal candidate should...SeniorPerformance
$150k - $230k
About Clockwork Systems Clockwork.io - Software Driven Fabrics to increase GPU cluster utilization Clockwork... ...and veteran systems engineers who share a vision for... ...distributed computing. As AI workloads grow... ...to meet the demands of performance, reliability, and precise...SeniorPerformance- ...you are a Research Engineer with expertise in... ...state-of-the-art AI innovations to make... ...maximizing efficiency and performance to achieve feats... ...' efficiency and inference speed on... ...models into production systems in a scalable way... ...memory usage and CPU/GPU utilization....SeniorPerformance
- 2100 NVIDIA USA is seeking a Senior System Software Engineer to join their GPU-accelerated deep learning software team. This role focuses on developing cutting-edge inference serving software for AI models while collaborating within the open-source community. Ideal candidates...Senior
$224k - $356.5k
NVIDIA is seeking a Senior Systems Software Engineer in Santa Clara to enhance performance architecture for GPU-accelerated data processing. With an emphasis on compiler techniques and structured data handling, this role requires over 12 years of experience and strong skills...SeniorPerformance$160k - $180k
...What You’ll Do As a Senior AI Systems Engineer, you will architect, deploy, and... ...scale AI model training and inference. You will ensure our machine... ...between raw data and high-performance AI models. Infrastructure &... ...AI-centric bare-metal and GPU clouds (Nebius AI Cloud). Cloud...SeniorPerformanceLocal area$200k - $322k
...are seeking a self‑motivated senior engineer for the Aerial Omniverse... ...of emulated devices, across systems of potentially thousands of... ...you will design and implement GPU kernels that apply time‑varying... ...we need to see PhD in high‑performance computing, computer...SeniorPerformance- ...experienced software engineer for its DGXC Data... ...supporting exabyte-scale AI workloads. You will... ...data management for GPU-based training and inference jobs. You will... ...and implement high-performance storage paths, integrate... ...object stores with file systems, and develop...SeniorPerformance
- Cerebras Systems builds the world’s largest AI chip with wafer-scale... ...leading training and inference speeds and... ...About The Role Senior Director of... ...intersection of product, engineering, sales, and... .../inference performance, scaling architectures... ...accelerators, GPU-based systems,...SeniorPerformance
- Apple’s Server ML Frameworks team in Cupertino seeks engineers to optimize high-performance GenAI applications. This role focuses on ML inference framework projects and GPU programming while collaborating with cross-functional teams to enhance performance. The ideal candidates...Performance
$126k - $248k
...’re looking for a Senior Engineer to help build the next-generation inference platform that supports... ..., retrieval, and AI-native experiences... ...on building core systems and services that... ...for reliability, performance, and ease of use.... ...performance, autoscaling, GPU utilization, and...SeniorPerformanceLocal areaFlexible hours- A cutting-edge AI company in California is looking... ...a Member of Technical Staff for Kernel/Compiler/... ...expertise in CUDA and GPU optimization, along... ...years of experience in performance engineering. The ideal candidate will... ...kernels and optimize systems for large GPU clusters...SeniorPerformance
- Majestic Labs ai seeks a Senior Thermal Engineer to own the full thermal design lifecycle for high-performance computing cooling systems. This on-site, IC role requires deep hands-on expertise... ...infrastructure, CFD simulation, and AI/GPU-based system design....SeniorPerformance
- NVIDIA is seeking a Senior System Software Engineer to enhance its Dynamo-Triton Inference Server. Your responsibilities will include developing GPU-accelerated AI inference software and facilitating the convergence of AI frameworks. Applicants should possess an MS or PhD...Senior
- ...Venture Capital is looking for an ML Systems Engineer to optimize LLM inference systems crucial for their AI platform. The role focuses on enhancing performance and efficiency via low-level... ...a strong background in ML systems, GPU optimization, and programming skills...Performance
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Staff AI Inference Systems Engineer — GPU/Performance. Be the first to apply!
- technology administrator Mountain View, CA
- engineering aide Mountain View, CA
- senior staff systems engineer Mountain View, CA
- staff data engineer Mountain View, CA
- software engineer staff Mountain View, CA
- senior staff engineer Mountain View, CA
- assistant engineer Mountain View, CA
- staff engineer Mountain View, CA
- ai engineer Mountain View, CA
- ai ml engineer Mountain View, CA

