Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Staff AI Inference Systems Engineer — GPU/Performance

$198k - $326k

LinkedIn

A prominent tech company in Mountain View is looking for a Sr. Staff Software Engineer in Systems Infrastructure to lead optimizations across AI inference systems. Candidates should have 8+ years of experience in software engineering, extensive knowledge of ML systems, and proficiency in Python or C++. The role requires technical leadership and innovative problem-solving to enhance performance and efficiency. This hybrid position offers a competitive salary between $198,000 and $326,000, depending on experience and location. #J-18808-Ljbffr LinkedIn

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Staff AI Inference Systems Engineer — GPU/Performance in Mountain View, CA vacancy
  • AMD is seeking a senior software engineer who blends deep systems performance work with AI, spanning GPU kernels to distributed training and inference. You’ll influence ROCm and AMD’s AI software strategy while mentoring others and tackling high-impact problems on AMD GPUs... 
    Senior
    Performance

    AMD

    Santa Clara, CA
    2 days ago
  • We are looking for a Senior System Software Engineer to work on Dynamo-Triton Inference Server. NVIDIA is hiring...  ...software engineers for its GPU-accelerated deep...  ...power a revolution in AI, enabling breakthroughs...  ...team building a highly‑performant AI inference platform to... 
    Senior
    Performance

    2100 NVIDIA USA

    Santa Clara, CA
    2 days ago
  •  ...an experienced professional to optimize AI workloads at DGX Station (Galaxy) in...  ...readiness of AI applications, profiling multi-GPU environments, and collaborating to...  ...candidate has over 12 years of experience in systems software engineering and strong expertise with deep learning... 
    Senior
    Performance

    Nvidia Corporation

    Santa Clara, CA
    2 days ago
  • NVIDIA is seeking an experienced Senior System Engineer to work on GPU rack platforms. This role involves integration, validation, and troubleshooting ensuring...  ...centers. Key responsibilities include collaborating on AI server designs, debugging early prototypes, and... 
    Senior

    NVIDIA

    Santa Clara, CA
    2 days ago
  • Clockwork Systems, Inc. is seeking an experienced Systems Engineer to design and implement high-performance distributed GPU training systems. This role involves working with GPU clusters, high-speed networking, and ensuring fault tolerance in complex systems. Ideal candidates... 
    Senior
    Performance

    Clockwork Systems, Inc.

    Palo Alto, CA
    2 days ago
  •  ...in California is seeking a skilled engineer to optimize deep learning frameworks...  ...for AMD GPUs. This role will enhance performance across multi-GPU systems, focus on GPU kernel development, and...  ...C++, Triton, and experience with AI frameworks like PyTorch and SGLang.... 
    Senior
    Performance
    Full time

    AMD

    Santa Clara, CA
    2 days ago
  • NVIDIA is seeking a Senior Systems Software Engineer to improve performance, reliability, and scalability of a system routing AI workloads across distributed GPU fleets. You’ll work on a polyglot platform with open source components, contributing to control plane and edge... 
    Senior
    Performance

    NVIDIA

    Santa Clara, CA
    2 days ago
  • $184k - $356k

    Nvidia Corporation is seeking a Senior Inference Engineer to advance AIConfigurator, optimizing deployment configurations for large-scale LLM...  ...and collaborating with multiple teams to improve deployment performance. The ideal candidate has a PhD or equivalent experience, 1... 
    Senior
    Performance

    Nvidia Corporation

    Santa Clara, CA
    2 days ago
  • $178.7k - $268.1k

     ...love. Our Vector Gamer AI team sits at the heart...  .... We’re hiring a Senior Backend Engineer to build and operate the...  ...operate the distributed systems that power billions of...  ..., with a focus on the performance, reliability, and scalability of inference systems. What You’ll... 
    Senior
    Performance
    Work at office
    Relocation package

    Unity

    Mountain View, CA
    2 days ago
  • $216k - $414k

     ...into the unlimited potential of AI to define the next era of...  ...architect with experience in high-performance networking technologies, DPUs...  ...: Enhance NVIDIA's future GPU Networking offerings for...  ...engage a globally distributed engineering team Eagerness to learn new technologies... 
    Senior
    Performance

    NVIDIA

    Santa Clara, CA
    2 days ago
  • $184k - $287.5k

    We are seeking software engineers to work on next-generation graphics...  ...demanding applications a GPU or high-performance computing server will encounter...  ..., a solid foundation of systems software with emphasis on OS...  ...existing vacancy. NVIDIA uses AI tools in its recruiting... 
    Senior
    Performance

    NVIDIA

    Santa Clara, CA
    2 days ago
  •  ...Member of Technical Staff — CI Engineer to improve CI reliability...  ...open-source LLM inference engine. The role requires...  ...of Linux and GPU computing, as well as...  ...building world-class AI infrastructure, ensuring fast and secure system performance. This is an opportunity... 
    Senior
    Performance

    RadixArk

    Palo Alto, CA
    4 days ago
  •  ...’re looking for a Senior Engineer to help build the next-generation inference platform that supports...  ..., retrieval, and AI-native experiences...  ...on building core systems and services that...  ...for reliability, performance, and ease of use....  ...performance, autoscaling, GPU utilization, and... 
    Senior
    Performance

    Gravity Engineering Services Pvt Ltd.

    Palo Alto, CA
    2 days ago
  • Tensordyne is seeking a Hardware Design Engineer in Sunnyvale, CA, to lead hardware system development. This role offers the chance to own critical aspects...  ..., PCB layout, and mechanical design, ensuring high-performance AI products. You will collaborate closely with ASIC,... 
    Senior
    Performance

    Tensordyne

    Sunnyvale, CA
    2 days ago
  • Senior Solution Architect - AI / GPU Cloud We are seeking a Senior Solution...  ...partner closely with engineering and operations...  ...compute to AI model inference API solutions. As an...  ...highest standards for performance, security, and...  ...cluster/orchestration systems, NVIDIA GPU stack (... 
    Senior
    Performance

    GMI Cloud

    Mountain View, CA
    2 days ago
  •  ...looking for a motivated Deep Learning engineer in Santa Clara, California, to advance communication technologies in AI environments. This role focuses on...  ...into AI frameworks, aiming to enhance performance and scalability in multi-GPU computing. The ideal candidate should... 
    Senior
    Performance

    2100 NVIDIA USA

    Santa Clara, CA
    2 days ago
  • $150k - $230k

    About Clockwork Systems Clockwork.io - Software Driven Fabrics to increase GPU cluster utilization Clockwork...  ...and veteran systems engineers who share a vision for...  ...distributed computing. As AI workloads grow...  ...to meet the demands of performance, reliability, and precise... 
    Senior
    Performance

    Clockwork.io

    Palo Alto, CA
    2 days ago
  •  ...you are a Research Engineer with expertise in...  ...state-of-the-art AI innovations to make...  ...maximizing efficiency and performance to achieve feats...  ...' efficiency and inference speed on...  ...models into production systems in a scalable way...  ...memory usage and CPU/GPU utilization.... 
    Senior
    Performance

    Otter.ai

    Mountain View, CA
    2 days ago
  • 2100 NVIDIA USA is seeking a Senior System Software Engineer to join their GPU-accelerated deep learning software team. This role focuses on developing cutting-edge inference serving software for AI models while collaborating within the open-source community. Ideal candidates... 
    Senior

    2100 NVIDIA USA

    Santa Clara, CA
    2 days ago
  • $224k - $356.5k

    NVIDIA is seeking a Senior Systems Software Engineer in Santa Clara to enhance performance architecture for GPU-accelerated data processing. With an emphasis on compiler techniques and structured data handling, this role requires over 12 years of experience and strong skills... 
    Senior
    Performance

    NVIDIA

    Santa Clara, CA
    2 days ago
  • $160k - $180k

     ...What You’ll Do As a Senior AI Systems Engineer, you will architect, deploy, and...  ...scale AI model training and inference. You will ensure our machine...  ...between raw data and high-performance AI models. Infrastructure &...  ...AI-centric bare-metal and GPU clouds (Nebius AI Cloud). Cloud... 
    Senior
    Performance
    Local area

    Archer56

    San Jose, CA
    2 days ago
  • $200k - $322k

     ...are seeking a self‑motivated senior engineer for the Aerial Omniverse...  ...of emulated devices, across systems of potentially thousands of...  ...you will design and implement GPU kernels that apply time‑varying...  ...we need to see PhD in high‑performance computing, computer... 
    Senior
    Performance

    NVIDIA

    Santa Clara, CA
    2 days ago
  •  ...experienced software engineer for its DGXC Data...  ...supporting exabyte-scale AI workloads. You will...  ...data management for GPU-based training and inference jobs. You will...  ...and implement high-performance storage paths, integrate...  ...object stores with file systems, and develop... 
    Senior
    Performance

    NVIDIA AI

    Santa Clara, CA
    2 days ago
  • Cerebras Systems builds the world’s largest AI chip with wafer-scale...  ...leading training and inference speeds and...  ...About The Role Senior Director of...  ...intersection of product, engineering, sales, and...  .../inference performance, scaling architectures...  ...accelerators, GPU-based systems,... 
    Senior
    Performance

    Cerebras

    Sunnyvale, CA
    3 days ago
  • Apple’s Server ML Frameworks team in Cupertino seeks engineers to optimize high-performance GenAI applications. This role focuses on ML inference framework projects and GPU programming while collaborating with cross-functional teams to enhance performance. The ideal candidates... 
    Performance

    Apple

    Cupertino, CA
    2 days ago
  • $126k - $248k

     ...’re looking for a Senior Engineer to help build the next-generation inference platform that supports...  ..., retrieval, and AI-native experiences...  ...on building core systems and services that...  ...for reliability, performance, and ease of use....  ...performance, autoscaling, GPU utilization, and... 
    Senior
    Performance
    Local area
    Flexible hours

    United States Digital Space LLC

    Palo Alto, CA
    3 days ago
  • A cutting-edge AI company in California is looking...  ...a Member of Technical Staff for Kernel/Compiler/...  ...expertise in CUDA and GPU optimization, along...  ...years of experience in performance engineering. The ideal candidate will...  ...kernels and optimize systems for large GPU clusters... 
    Senior
    Performance

    RadixArk

    Palo Alto, CA
    3 days ago
  • Majestic Labs ai seeks a Senior Thermal Engineer to own the full thermal design lifecycle for high-performance computing cooling systems. This on-site, IC role requires deep hands-on expertise...  ...infrastructure, CFD simulation, and AI/GPU-based system design.... 
    Senior
    Performance

    Majestic Labs ai

    Los Altos, CA
    2 days ago
  • NVIDIA is seeking a Senior System Software Engineer to enhance its Dynamo-Triton Inference Server. Your responsibilities will include developing GPU-accelerated AI inference software and facilitating the convergence of AI frameworks. Applicants should possess an MS or PhD... 
    Senior

    NVIDIA

    Santa Clara, CA
    2 days ago
  •  ...Venture Capital is looking for an ML Systems Engineer to optimize LLM inference systems crucial for their AI platform. The role focuses on enhancing performance and efficiency via low-level...  ...a strong background in ML systems, GPU optimization, and programming skills... 
    Performance

    ScOp Venture Capital

    Santa Clara, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Staff AI Inference Systems Engineer — GPU/Performance. Be the first to apply!