Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Platform Engineer, NIM SDK & Framework AI Inference

$184k - $356.5k

NVIDIA Gruppe

NVIDIA Gruppe is seeking a Senior Engineer to lead the evolution of the core NIM Platform SDK and microservice framework in Santa Clara, California. This hands-on role involves architecting significant new features and solving complex engineering challenges. The ideal candidate will have a background in high-performance systems programming and significant experience with cloud-native architectures, contributing to production-grade software supporting AI applications. The position offers a competitive salary ranging from 184,000 to 356,500 USD based on level and experience, alongside equity and benefits. #J-18808-Ljbffr NVIDIA Gruppe

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior Platform Engineer, NIM SDK & Framework AI Inference in Santa Clara, CA vacancy
  • $184k - $287.5k

     ...Senior Engineer, NIM Platform SDK and Microservice Framework NVIDIA is the platform for every new AI-powered application. We seek a senior engineer to own and evolve the core NIM...  ...modalities in delivering production-ready AI inference at scale. This is a hands-on, deeply... 
    Senior

    NVIDIA

    Santa Clara, CA
    5 days ago
  • $184k - $287.5k

     ...skilled Agentic AI Software Engineer to join our team....  ...integrations of NVIDIA NIM microservices and...  ...agentic AI frameworks and open-source libraries...  ...NVIDIA model and inference support in agent orchestration platforms and tooling....  ..., Claude Agent SDK, OpenAI Agents SDK... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  •  ...computing experiences-from AI and data centers, to PCs,...  .... THE ROLE: As a senior member of the LLM inference framework team, you will be...  ...deployments and benchmarking platforms (e.g., InferenceMax, MLPerf...  ...intersection of inference engines, distributed systems, and... 
    Senior

    Advanced Micro Devices , Inc.

    Santa Clara, CA
    3 days ago
  • $332k

    We are looking for a Senior leader to orchestrate embedded NVIDIA AI software Go‑To‑...  ...and use of the NVIDIA platform, including hardware...  ...Implement a leadership Inference go‑to‑market strategy...  ...including NVIDIA AI SDK and Frameworks (NeMo, Riva, NIMs, Triton, RAPIDS,... 
    Senior
    Worldwide

    NVIDIA Gruppe

    Santa Clara, CA
    5 days ago
  • $236k - $339.25k

     ...this new era, we seek AI-native thinkers across...  ...Snowflake Machine Learning Platform team's mission is to...  ...and proactively with senior architects, PMs, and...  ...learning services, and frameworks. Strong track...  ...in serving LLMs using inference engines like vLLM, TensorRT-LLM... 
    Senior
    Flexible hours

    Snowflake Computing

    Menlo Park, CA
    5 days ago
  • $152k - $241.5k

    Overview AI & Deep Learning Compiler Engineer for NVIDIA’s Deep Learning & AI Compiler (DLC) team. What you’ll be doing Analyze deep learning networks...  ...algorithms. Collaborate with deep learning software framework teams and GPU architecture teams to accelerate the next... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    5 days ago
  • Israelvcforum is looking for a Senior ML Infrastructure Engineer in Mountain View, California. This position aims to build and scale robust platforms for ML inference workflows supporting GM’s AI efforts. You will collaborate with ML engineers and researchers to implement... 
    Senior
    Remote job

    Israelvcforum

    Mountain View, CA
    5 days ago
  • $152k - $241.5k

     ...now looking for a Senior Software Engineer for Deep Learning Inference! Would you like to...  ...-the-art inference framework for accelerating Deep...  ...scaled to multiple platforms for functionality and...  ...TensorRT, NVIDIA’s SDK for high-...  ...vacancy. NVIDIA uses AI tools in its recruiting... 
    Senior

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $184k - $356.5k

    NVIDIA Gruppe is looking for skilled software engineers to develop AI inference systems that operate with high efficiency. The role involves architecting high-performance inference frameworks and optimizing GPU processes. Ideal candidates should have extensive programming... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    5 days ago
  • $199.7k - $254.6k

     ...Team Join Cisco's CX AI Incubation Team as a Senior AI/MLDevOpsEngineer and...  ...collaborate with product and engineering teams to deploy reliable,...  ...run production-grade AI platforms and services that...  .../SLMs, including on-prem inference packaging, runtime optimization... 
    Senior
    Full time
    Temporary work
    Local area
    Flexible hours

    Cisco

    San Jose, CA
    3 days ago
  •  ...hire a deeply technical, creative, and Senior AI Platform Engineer to build, support, and maintain the...  ...Hugging Face, Weights & Biases, NVIDIA NIM). Proven use of AI agents and LLM...  ...FedRAMP, SOC 2, or other compliance frameworks relevant to your environment, and red... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    5 days ago
  • $155.42k - $395.9k

     ...Description About the Team: The ML Inference Platform is part of the AV ML...  ...that powers GM’s AI efforts. We’re proud to serve...  ...Role: We are seeking a Senior ML Infrastructure engineer to help build and scale robust...  ...of-the‑art model serving frameworks, hardware accelerators,... 
    Senior
    Local area
    Remote work
    Relocation
    Relocation package
    Flexible hours

    Israelvcforum

    Mountain View, CA
    5 days ago
  • Acceler8 Talent is seeking a Senior / Principal Machine Learning Engineer specializing in inference serving frameworks. This role involves designing and optimizing multi-node inference...  ...startup environment to work on cutting-edge AI infrastructure. #J-18808-Ljbffr Acceler8... 
    Senior

    Acceler8 Talent

    Santa Clara, CA
    2 days ago
  • $168k - $258.75k

     ...Product Manager For Ai Platform Recommender Systems At NVIDIA we...  ...means we build best in class frameworks in OSS and support a robust...  ...Create and optimize pre-training/inference and post-training frameworks...  ...Computer Science, Computer Engineering, or similar experience (or... 
    Senior

    NVIDIA

    Santa Clara, CA
    2 days ago
  •  ...10 years Job Title* and Job band Senior Agentic Platform Engineer Detailed job description - Skill Set...  .../CD processes required for reliable AI deployment Mandatory Skills *10 years...  ...with data privacy and security frameworks (GDPR, SOC2) as they apply to autonomous... 
    Senior
    Contract work
    Local area

    eTeam

    Sunnyvale, CA
    4 days ago
  • $156.8k - $229.7k

     ...crossroads. As we ramp up investments in AI-driven product features, the Platform Engineering team is the engine room for this...  ...Platforms : Building the frameworks for autonomous AI agents. AI Observability...  ...workflows. We are seeking a Senior AI Platform Engineer to lead the... 
    Senior
    Full time

    GFiber

    Sunnyvale, CA
    3 days ago
  • $148k - $224.25k

     ...unlimited potential of AI to define the next...  ...on to operate inference and agentic...  ...Manager to drive NVCF platform features and developer...  ...Collaborate with engineering on feature design,...  ...and SDKs, agent frameworks. ~ Proven capability...  ...to connect with senior technical... 
    Senior

    NVIDIA

    Santa Clara, CA
    2 days ago
  • $184k - $356.5k

    NVIDIA Corporation is seeking a Senior Deep Learning Software Engineer specializing in Inference to join their growing team in...  ...accelerated software for advanced AI applications, including...  ...high-performance deep learning frameworks like SGLang and vLLM. Candidates... 
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    2 days ago
  • $120.5k - $243k

     ...Senior Platform Software Engineer This role has been designed as ‘Hybrid’ with an expectation that you will...  ...security functions, and underlying SoC SDK or drivers to meet high-performance...  ...subsystems. • Preferred: Experience with AI tools for coding assistance (e.g.,... 
    Senior
    Work experience placement
    Work at office
    Local area
    Immediate start
    2 days per week

    HPE

    Sunnyvale, CA
    6 days ago
  • $181.1k - $318.4k

     ...Senior/Staff Software Engineer - AI, Search & Knowledge Platforms Work Locations (2) Submit Resume The AI, Search & Knowledge...  ...and to Private Cloud Compute inference infrastructure. As a member of...  ...or similar serialization/RPC frameworks. Experience building CI/CD... 
    Senior
    Relocation

    Apple

    Santa Clara, CA
    1 day ago
  •  ...Senior Cloud Platform Engineer San Jose, California, United States The era of pervasive AI has arrived. In this era, organizations will use...  ...focus will be ensuring our inference endpoints have exceptional...  ...of model serving frameworks like vLLM, SGLang or Ray.... 
    Senior
    Full time
    Temporary work
    Local area
    Immediate start
    Flexible hours
    Shift work

    SambaNova Systems

    San Jose, CA
    5 days ago
  • $224k - $356.5k

     ...unlimited potential of AI to define the next era of...  ...ambitious system software engineer to join the team working on NVIDIA GeForce Now Platform ( The main focus of the...  ...developing services and framework-like SDKs, like COM or Windows Runtime SDK Familiarity with... 
    Senior
    Local area

    NVIDIA

    Santa Clara, CA
    5 days ago
  • $168k - $258.75k

     ...programs for Deep Learning Training and Inference Frameworks, with the goal of supporting NVIDIA's top AI researchers and software engineers in driving the future of deep learning....  ...evolving roadmap. The TPM will work alongside senior management and coordinate efforts with... 
    Senior
    Remote work
    Shift work

    NVIDIA

    Santa Clara, CA
    1 day ago
  •  ...Building the world’s leading AI-powered, cloud-native...  ...’re hiring a Software Engineer to help scale a working...  ...a flexible, extensible platform. You’ll design core...  ...provider acceptance test framework. Begin HCD connector...  ...development — the plugin SDK, resource lifecycle, state... 
    Senior
    Local area
    Flexible hours

    IBM Computing

    San Jose, CA
    4 days ago
  • $152k - $241.5k

     ...driving advancements in AI and machine...  ...talented and motivated engineers to join our...  ...leading deep learning inference software for...  ...accelerators. As a Senior Software Engineer...  ...developing Deep Learning Frameworks, Compilers, or...  ...computing platform driving our success... 
    Senior

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $168k - $270.25k

     ...Senior Engineer For Factory Infrastructure And Automation NVIDIA is the platform upon which every new AI-powered application is built. We are seeking a senior engineer to...  ...infrastructure and automation for NVIDIA Inference Microservices (NIMs). The right person for this role... 
    Senior

    NVIDIA

    Santa Clara, CA
    5 days ago
  • $212k - $318.4k

     ...Senior Machine Learning Platform Engineer - AI, Search & Knowledge Work Locations (2) Submit Resume Join us...  ...Knowledge platform and the diverse ML frameworks used across Apple, including...  ...Serve, TorchServe, TensorRT) or inference optimization Contributions to... 
    Senior
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • $128.7k - $261.3k

     ...Team The Model Deployment & Inference Solutions team in GM AV...  ...learning models from training frameworks (e.g. PyTorch) onto autonomous...  ...: build the ML deployment platform that makes model rollouts fast...  ...performed manually by engineers. Build the developer experience... 
    Senior
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours
    Shift work

    General Motors

    Mountain View, CA
    4 days ago
  • $184k - $287.5k

     ...stack for distributed inference which will be used to...  ...the world by applying AI inference aware technology...  ...them to AI-Grid platforms and SDKs by providing...  ...Computer Science, Electrical Engineering, Software Engineer, or...  ...and orchestration frameworks with strong foundation... 
    Senior
    Work experience placement

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $224k - $356.5k

     ...unlimited potential of AI to define the next...  ...world. As a Senior Developer...  ...Manager for Data Platforms, you’ll work with...  ...business, product, and engineering levels. Build relationships...  ...libraries, SDKs, NIMs, and blueprints),...  ...LLMs and AI/ML frameworks Experience with... 
    Senior

    NVIDIA

    Santa Clara, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Platform Engineer, NIM SDK & Framework AI Inference. Be the first to apply!