Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Inference & Deployment Systems Engineer

$184k - $356k

Nvidia Corporation

Nvidia Corporation is seeking a Senior Inference Engineer to advance AIConfigurator, optimizing deployment configurations for large-scale LLM inference on NVIDIA platforms. The role involves building production-quality APIs and collaborating with multiple teams to improve deployment performance. The ideal candidate has a PhD or equivalent experience, 10+ years in software engineering, and strong skills in Python and Rust. Salary ranges from $184K to $356K based on level and experience, with additional equity and benefits offered. #J-18808-Ljbffr Nvidia Corporation

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior AI Inference & Deployment Systems Engineer in Santa Clara, CA vacancy
  • NVIDIA is seeking a Senior System Software Engineer to enhance its Dynamo-Triton Inference Server. Your responsibilities will include developing GPU-accelerated AI inference software and facilitating the convergence of AI frameworks. Applicants should possess an MS or PhD... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

    NVIDIA is seeking AI systems engineers to innovate in the inference systems software stack. The role involves designing and optimizing libraries and kernel technologies, significantly impacting AI workloads. Candidates should have a Master's degree (PhD preferred) and over... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

    NVIDIA Gruppe is seeking talented AI systems engineers to advance innovative technologies in AI inference systems software. This role involves developing cutting-edge libraries, code generators, and kernel technologies for NVIDIA's architecture, emphasizing high-impact... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  • Dormont Manufacturing Co in Sunnyvale, California is seeking a Senior Engineer responsible for leading designs and delivering improvements...  ...The ideal candidate has 3-8 years of experience in distributed systems, strong coding skills in Python or Go, and familiarity with... 
    Senior

    Dormont Manufacturing Co

    Sunnyvale, CA
    2 days ago
  •  ...Member of Technical Staff — Inference to push the limits of large-scale AI inference. You will design and optimize core systems that serve frontier...  ...The role blends systems engineering, ML infrastructure, and...  ...state‑of‑the‑art models are deployed and experienced by users... 
    Senior
    Worldwide

    RadixArk

    Palo Alto, CA
    14 hours ago
  • A leading AI infrastructure company in California is seeking a Member of Technical Staff — Inference to design and optimize large-scale AI inference systems. The role demands 5+ years in systems engineering and expertise in large-scale inference systems. Successful candidates... 
    Senior
    Flexible hours

    RadixArk

    Palo Alto, CA
    4 days ago
  • $198k - $326k

    A prominent tech company in Mountain View is looking for a Sr. Staff Software Engineer in Systems Infrastructure to lead optimizations across AI inference systems. Candidates should have 8+ years of experience in software engineering, extensive knowledge of ML systems,... 
    Senior

    LinkedIn

    Mountain View, CA
    1 day ago
  •  ...company in California is seeking a skilled engineer to optimize deep learning frameworks for...  ...enhance performance across multi-GPU systems, focus on GPU kernel development, and collaborate...  ...GPGPU C++, Triton, and experience with AI frameworks like PyTorch and SGLang. A... 
    Senior
    Full time

    AMD

    Santa Clara, CA
    1 day ago
  • 2100 NVIDIA USA is seeking a Senior System Software Engineer to join their GPU-accelerated deep learning software team. This role focuses on developing cutting-edge inference serving software for AI models while collaborating within the open-source community. Ideal candidates... 
    Senior

    2100 NVIDIA USA

    Santa Clara, CA
    1 day ago
  • Staff Runtime Systems Engineer Hybrid, working onsite at our Santa Clara, CA, headquarters 3 days per week. What You Will Do d-Matrix is developing an AI compute platform focusing on in-memory compute for AI inference in datacenters. This position is for runtime software... 
    Senior
    3 days per week

    d-Matrix inc.

    Santa Clara, CA
    1 day ago
  • Tensordyne is seeking a Hardware Design Engineer in Sunnyvale, CA, to lead hardware system development. This role offers the chance to own critical aspects of...  ...layout, and mechanical design, ensuring high-performance AI products. You will collaborate closely with ASIC,... 
    Senior

    Tensordyne

    Sunnyvale, CA
    1 day ago
  • AMD is seeking a senior software engineer who blends deep systems performance work with AI, spanning GPU kernels to distributed training and inference. You’ll influence ROCm and AMD’s AI software strategy while mentoring others and tackling high-impact problems on AMD GPUs... 
    Senior

    AMD

    Santa Clara, CA
    1 day ago
  • $160k - $180k

     ...What You’ll Do As a Senior AI Systems Engineer, you will architect, deploy, and manage the critical infrastructure services required for large-scale AI model training and inference. You will ensure our machine learning platforms are robust and efficient, bridging the... 
    Senior
    Local area

    Archer56

    San Jose, CA
    1 day ago
  • NVIDIA is seeking a Sr. Software Engineer in Santa Clara specializing in AI products for semiconductor inspection. This role focuses on developing production-ready models and inference pipelines designed to enhance semiconductor manufacturing processes. Ideal candidates... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • NVIDIA is seeking a data storage engineer to advance cloud-native storage across AI workloads. You will design storage technologies, client libraries, and...  ...hybrid environments. You will optimize training and inference data paths, build observability tooling, and work with... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $135.8k - $237.05k

     ...love. Our Vector Gamer AI team sits at the...  ...scale. We're hiring a Senior Backend Engineer to build and operate...  ...operate the distributed systems that power billions...  ..., and scalability of inference systems. Join us and...  ...Design, develop, and deploy production-grade backend... 
    Senior
    Work at office
    Worldwide
    Relocation package

    Unity

    Mountain View, CA
    1 day ago
  •  ...seeking an experienced software engineer for its DGXC Data Services...  ...infrastructure supporting exabyte-scale AI workloads. You will contribute...  ...for GPU-based training and inference jobs. You will design and...  ...integrate object stores with file systems, and develop telemetry to... 
    Senior

    NVIDIA AI

    Santa Clara, CA
    1 day ago
  • $181.1k - $318.4k

     ...truly believe it can. We are the System Intelligent and Machine...  ...datasets, ingestion of annotated/inferred data into our systems, and making...  ...pro, or an outstanding engineer wanting to expand your horizons...  ...experience in machine learning, AI, computer vision, or a related... 
    Senior
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • ScOp Venture Capital is looking for an ML Systems Engineer to optimize LLM inference systems crucial for their AI platform. The role focuses on enhancing performance and efficiency via low-level systems optimization, directly impacting industry leader processes in semiconductor... 

    ScOp Venture Capital

    Santa Clara, CA
    1 day ago
  • $152k - $241.5k

    NVIDIA is seeking a Solutions Architect in Santa Clara to enhance AI inference solutions using GPU technology and Kubernetes. You will work with engineering teams to develop enterprise AI solutions. Requirements include over 5 years of experience in Solutions Architecture... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

    NVIDIA is seeking an experienced AI systems engineer to innovate and develop cutting-edge technologies in AI inference systems. You will design and optimize kernel technologies to accelerate workloads for NVIDIA's hardware architecture. The ideal candidate holds a Master... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  •  ...in Sunnyvale, CA, is seeking a senior ASIC verification expert to...  ...processors aimed at generative AI inference acceleration. You will work closely with design engineers, ensuring pre-silicon correctness...  ...testing strategies using System Verilog and UVM. This dynamic... 
    Senior
    Remote job

    Tensordyne

    Sunnyvale, CA
    1 day ago
  •  ...innovative projects at the convergence of CUDA and Deep Learning Systems. In this role, you will work collaboratively to explore...  ...programming skills, with a focus on enhancing performance in multi-node AI systems. This role offers competitive compensation and equity opportunities... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • A leading AI technology firm in Sunnyvale, California, is hiring a Senior Performance Analyst. You will focus on performance benchmarking...  ...and competitive pricing for their inference product. The role requires deep knowledge of ML systems and open-source frameworks, with at... 
    Senior

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  • $176k - $276k

    NVIDIA is seeking a Storage Production Engineer based in Santa Clara, California, to design and maintain robust storage solutions...  ...experience in distributed storage solutions and AI/ML workflows, ensuring system efficiency and data integrity. With a degree in Computer... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  •  ...and fleet strategy for the AI Inference Service organization, collaborating...  ...closely with teams across Engineering, Product, and Operations....  ...include managing daily deployment tracking, leading strategic...  ...effective utilization of AI systems. This role offers a unique opportunity... 
    Senior

    Cerebras

    Sunnyvale, CA
    3 days ago
  • $147.4k - $272.1k

     ...California, United States Machine Learning and AI Apple is where individual imaginations...  ...ideas into powerful, usable features and systems. We work with the latest AI research and...  ...with API design, both for other engineers to use, but also for AI systems. At Apple... 
    Senior
    Relocation

    Apple

    Cupertino, CA
    2 days ago
  • A technology solutions provider seeks a Senior Forward Deployed Engineer in Sunnyvale, CA. The role involves collaborating with customers to deliver technical solutions integrating Generative AI, Machine Learning, and Computer Vision. Responsibilities include project management... 
    Senior

    Nexxa.ai

    Sunnyvale, CA
    1 day ago
  • Cerebras Systems, Inc. is looking for a Sr. Member of Technical Staff to design software features that enhance system resiliency...  ...environments. The role includes developing scalable AI inference services and deploying cloud-based workflows. Ideal candidates have a master's... 
    Senior

    Cerebras Systems, Inc.

    Sunnyvale, CA
    4 days ago
  • Advanced Micro Devices is looking for a Senior Product Manager in Santa Clara, CA, to...  ...open-source community, and partner with engineering teams to meet customer needs....  ...product management, GPU computing, and AI inference technologies. This role provides an opportunity... 
    Senior

    Advanced Micro Devices

    Santa Clara, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Inference & Deployment Systems Engineer. Be the first to apply!