Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior RDMA Networking Engineer for AI Inference Pods

$150k - $275k

Jobleads-US

A leading AI infrastructure company based in San Jose is seeking a highly skilled Supercomputing Engineer specialized in networking. This role involves developing high-performance networking solutions and optimizing software communication across inference nodes. Candidates should have strong C/C++ skills and experience with RDMA technologies. The position offers a competitive salary range of $150,000 to $275,000, full medical benefits, and relocation support for newcomers. #J-18808-Ljbffr Jobleads-US

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior RDMA Networking Engineer for AI Inference Pods in San Jose, CA vacancy
  • NVIDIA Corporation is seeking a customer‑facing engineer specializing in AI networking systems. You will lead expert customer engagements on NVIDIA Networking...  .... The role emphasizes high‑performance networking, RDMA, and deep debugging in C/C++, with opportunities to... 
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    2 days ago
  • $152k - $241.5k

     ...deep learning ignited modern AI — the next era of computing —...  ...AI & Deep Learning Compiler Engineer. NVIDIA is hiring software engineers...  ...the backbone of NVIDIA’s inference engine, spanning across data...  ...:Analyzing deep learning networks and developing compiler optimization... 
    Senior
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    1 day ago
  • NVIDIA seeks a Senior Product Manager for AI Platform Inference (Finance) in Santa Clara to lead tooling, SDKs, and libraries enabling GPU-based inference deployments. You will craft strategy, roadmaps, and market plans, collaborating with developers to optimize models... 
    Senior

    Nvidia Corporation in

    Santa Clara, CA
    3 days ago
  •  ...Superintelligence Cloud, is a leader in AI cloud infrastructure serving...  ...on deploying and configuring networking Hardware for new and existing...  ...on-call rotation for Network Engineering teamYouHave 10+ years of...  ...VLs, partitions), GPUDirect RDMA concepts.Experience with DWDM... 
    Senior
    Work at office
    Local area
    Work from home
    Flexible hours

    Lambda Labs

    San Jose, CA
    3 days ago
  • NVIDIA in Santa Clara, CA seeks a senior software engineer focusing on GPU computing and ML inference to optimize LLM workloads on edge AI hardware. You will track open-source inference frameworks, map architectures to NVIDIA GPUs, and report performance metrics. With... 
    Senior

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $224k - $356.5k

    We are now looking for a Senior System Software Engineer to work on Dynamo. NVIDIA is...  ...to power a revolution in AI, enabling breakthroughs in...  ...team building Generative AI inference platform to make design...  ...caches, or high-performance networking for long-context,... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $184k - $287.5k

     ...forefront of the generative AI revolution, building...  ...We are looking for a Senior Software Engineer to lead the bring-up,...  ...training and inference workloads across NVIDIA...  ...across compute, memory, networking, and communication...  ...familiarity with the RDMA software stack (NCCL,... 
    Senior
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    1 day ago
  • DDN is seeking a Senior Software Engineering Manager to lead the engineering organization...  ...large-scale LLM inference across GPU clusters.In this...  ...distributed systems that power AI inference. You will define...  ..., distributed caching, RDMA networking, GPUDirect Storage, NVIDIA... 
    Senior

    DataDirect Networks

    Santa Clara, CA
    14 hours ago
  • $193.93k - $352.29k

     ...driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets,...  ...data generation to on-road validation.Maintain an in-house ML inference platform to serve large language models efficiently.Maintain an... 
    Senior
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    2 days ago
  • $262k - $364k

     ...coach a distributed engineering team, fostering...  ...reliability.Performance and Network Engineering:...  ...to accelerate HPC, RDMA, and ML workloads.Strategic...  ...RDMA, storage, and AI/ML, staying ahead of training and inference advancements....  ...Storage (GDS).As a Senior Staff Software... 
    Senior
    Remote work
    Worldwide

    Google

    Sunnyvale, CA
    3 days ago
  • $184k - $287.5k

    Joining NVIDIA's DGX Cloud AI Efficiency Team means...  ..., post-training, inference. Our objective is to deliver...  ...software engineer to join our team. You'll...  ...availability of AI systems.As a senior DGX Cloud AI Infrastructure...  ...stackExperience with RDMA software stack (NCCL, IB... 
    Senior
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    1 day ago
  • $182.5k - $260.5k

     ...leader in modern security and networking for the cloud and AI era. We secure and...  ...platform, its Zero Trust Engine, and the powerful NewEdge...  ...Positions are available at Senior Staff and above. Candidates...  ...Learning Scientist, you own the inference and optimization layer... 
    Senior

    Netskope

    Santa Clara, CA
    2 days ago
  •  ...features that enhance system resiliency and high availability across distributed environments. The role includes developing scalable AI inference services and deploying cloud-based workflows. Ideal candidates have a master's degree and significant experience with deployment... 
    Senior

    Cerebras Systems, Inc.

    Sunnyvale, CA
    4 days ago
  • $230k - $250k

     ...seeking a Sr. Member of Technical Staff in Sunnyvale, CA. This role involves designing resilient software features for cloud-based AI inference, leveraging AWS tools and services. Candidates should have a Master’s degree in Computer Science and experience with... 
    Senior

    Cerebras Systems

    Sunnyvale, CA
    9 hours ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This...  ...deliver industry-leading training and inference speeds; over 10 times faster than GPU-based...  ...RoleWe are seeking a highly skilled WAN Network Engineer to design, implement, manage, and... 
    Senior

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  • $134.5k - $193.5k

     ...digitizing, energy-intensive world. From revolutionizing power for AI-driven data centers to ensuring resilience for hospitals,...  ...challenges of the 21st century.  We are looking for a  Senior Network Engineer to join our team in one of today’s most exciting technologies... 
    Senior
    Full time
    Work at office
    Worldwide

    Bloom Energy

    San Jose, CA
    4 days ago
  • $140k - $224.25k

    The NVIDIA Experience (NVEX) Solutions Engineering team is looking for a senior Computer or Software Engineer who is ready to become an authority in ground-breaking network technology used in AI clusters. Our team of software engineers bridge the gap between the customer... 
    Senior
    Full time
    Weekend work

    Nvidia

    Santa Clara, CA
    19 hours ago
  •  ...generation computing experiences—from AI and data centers, to PCs, gaming and embedded...  ...ROLEWe are seeking a Principal GenAI Inference Optimization Engineer to join our Models and Applications...  ...such as PCIe/Infinity Fabric/RDMA).- Experience with GenAI inference optimization... 

    AMD

    San Jose, CA
    19 hours ago
  • $184k - $287.5k

    We are looking for a Network/Storage Test Engineer to join our End-to-End Cloud solution team. You are going to be part of the E2E Verification team...  ...2026.This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.NVIDIA is committed to fostering... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $169.78k - $338.69k

     ...efficient, user-oriented autonomous fleet. About The Role We are seeking an experienced and mission-driven Senior/Staff AI Infrastructure Engineer, Inference & Optimization to lead the performance tuning, deployment, and resource scheduling of cutting-edge AI models... 
    Senior
    Full time

    DiDi Labs

    San Jose, CA
    2 days ago
  • $184k - $287.5k

     ...into the unlimited potential of AI to define the next era of computing...  ...the world.We are looking for a Senior Linux Kernel Software Engineer to join the Linux networking drivers R&D team. The work...  ...internalsHands-on expertise with RDMA and RoCEA Master's or equivalent... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $184k - $287.5k

     ...tapping into the unlimited potential of AI to define the next era of computing....  ...are seeking an outstanding Software Engineer to join our US-based networking software team. As a technical leader...  .../CSPs.Hands-on expertise with RDMA verbs, DPDK, DOCA, NCCL, CUDA-aware... 
    Senior
    Full time
    Shift work

    Nvidia

    Santa Clara, CA
    3 days ago
  • $152k - $241.5k

    NVIDIA is changing the world of AI Networking with groundbreaking technology. We are excited...  ...Data Center scale systems for AI training/inference and lower level benchmarks. We strive...  ...degree in Computer Science / Software engineering or equivalent experience.5+ years of experience... 
    Senior
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    19 hours ago
  • $152k - $241.5k

     ...already made a significant impact in the AI and Software-Defined Networking fields which are broadly used across...  ...opportunities. This customer-facing engineering role is for an expert in AI...  ...experience in Remote Direct Memory Access (RDMA), AI workloads, NCCL, CUDA,... 
    Senior
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    3 days ago
  • $168k - $264.5k

     ...transform the way people work and play. NVIDIA is seeking a Senior Network Deployment Engineer to help build and scale our global network. In this role,...  ...2026.This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.NVIDIA is committed to... 
    Senior
    Full time
    Contract work
    Work experience placement
    Remote work
    Shift work

    Nvidia

    Santa Clara, CA
    3 days ago
  • NVIDIA Corporation in Santa Clara, CA is seeking outstanding AI systems engineers to develop groundbreaking inference technologies for the hardware-accelerated stack. You will create libraries, code generators, and GPU kernel innovations for LLM workloads. Join a team... 
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    3 days ago
  • $168k - $264.5k

    NVIDIA is looking for a Senior Network Engineer to develop a cloud network infrastructure. The goal is to craft a reliable, scalable and efficient...  ..., 2026.This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.NVIDIA is committed to... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $184k - $287.5k

     ...advanced multi-rack, multi-tenant AI/ML datacenters with NVIDIA...  ...GB300 GPUs. NVIDIA seeks a Senior Software Engineer for our CSP (Cloud Service...  ..., device-plugin crashes, RDMA/IB fabric anomalies, etc.Gather...  ...cloud-native stacks across networking (RDMA/RoCE), storage, and control... 
    Senior
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    1 day ago
  • $167.7k - $245.2k

     ...solutions that power the largest networks in the world. Engineers on this team will...  ...and India.Your ImpactAs a Senior QA Engineer, you will be responsible...  ...experience with RDMA (Remote Direct Memory Access...  ...protect organizations in the AI era - and beyond. We’ve been... 
    Senior
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Worldwide
    Flexible hours
    3 days per week

    CISCO Systems

    Milpitas, CA
    2 days ago
  • $184k - $287.5k

    NVIDIA is seeking an experienced AI systems engineer to innovate and develop cutting-edge technologies in AI inference systems. You will design and optimize kernel technologies to accelerate workloads for NVIDIA's hardware architecture. The ideal candidate holds a Master... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior RDMA Networking Engineer for AI Inference Pods. Be the first to apply!