Senior Platform Engineer, NIM SDK & Framework AI Inference
$184k - $356.5kNVIDIA Gruppe
NVIDIA Gruppe is seeking a Senior Engineer to lead the evolution of the core NIM Platform SDK and microservice framework in Santa Clara, California. This hands-on role involves architecting significant new features and solving complex engineering challenges. The ideal candidate will have a background in high-performance systems programming and significant experience with cloud-native architectures, contributing to production-grade software supporting AI applications. The position offers a competitive salary ranging from 184,000 to 356,500 USD based on level and experience, alongside equity and benefits. #J-18808-Ljbffr NVIDIA Gruppe
$184k - $287.5k
...Senior Engineer, NIM Platform SDK and Microservice Framework NVIDIA is the platform for every new AI-powered application. We seek a senior engineer to own and evolve the core NIM... ...modalities in delivering production-ready AI inference at scale. This is a hands-on, deeply...Senior$184k - $287.5k
...skilled Agentic AI Software Engineer to join our team.... ...integrations of NVIDIA NIM microservices and... ...agentic AI frameworks and open-source libraries... ...NVIDIA model and inference support in agent orchestration platforms and tooling.... ..., Claude Agent SDK, OpenAI Agents SDK...Senior- ...computing experiences-from AI and data centers, to PCs,... .... THE ROLE: As a senior member of the LLM inference framework team, you will be... ...deployments and benchmarking platforms (e.g., InferenceMax, MLPerf... ...intersection of inference engines, distributed systems, and...Senior
$332k
We are looking for a Senior leader to orchestrate embedded NVIDIA AI software Go‑To‑... ...and use of the NVIDIA platform, including hardware... ...Implement a leadership Inference go‑to‑market strategy... ...including NVIDIA AI SDK and Frameworks (NeMo, Riva, NIMs, Triton, RAPIDS,...SeniorWorldwide$236k - $339.25k
...this new era, we seek AI-native thinkers across... ...Snowflake Machine Learning Platform team's mission is to... ...and proactively with senior architects, PMs, and... ...learning services, and frameworks. Strong track... ...in serving LLMs using inference engines like vLLM, TensorRT-LLM...SeniorFlexible hours$152k - $241.5k
Overview AI & Deep Learning Compiler Engineer for NVIDIA’s Deep Learning & AI Compiler (DLC) team. What you’ll be doing Analyze deep learning networks... ...algorithms. Collaborate with deep learning software framework teams and GPU architecture teams to accelerate the next...Senior- Israelvcforum is looking for a Senior ML Infrastructure Engineer in Mountain View, California. This position aims to build and scale robust platforms for ML inference workflows supporting GM’s AI efforts. You will collaborate with ML engineers and researchers to implement...SeniorRemote job
$152k - $241.5k
...now looking for a Senior Software Engineer for Deep Learning Inference! Would you like to... ...-the-art inference framework for accelerating Deep... ...scaled to multiple platforms for functionality and... ...TensorRT, NVIDIA’s SDK for high-... ...vacancy. NVIDIA uses AI tools in its recruiting...Senior$184k - $356.5k
NVIDIA Gruppe is looking for skilled software engineers to develop AI inference systems that operate with high efficiency. The role involves architecting high-performance inference frameworks and optimizing GPU processes. Ideal candidates should have extensive programming...Senior$199.7k - $254.6k
...Team Join Cisco's CX AI Incubation Team as a Senior AI/MLDevOpsEngineer and... ...collaborate with product and engineering teams to deploy reliable,... ...run production-grade AI platforms and services that... .../SLMs, including on-prem inference packaging, runtime optimization...SeniorFull timeTemporary workLocal areaFlexible hours- ...hire a deeply technical, creative, and Senior AI Platform Engineer to build, support, and maintain the... ...Hugging Face, Weights & Biases, NVIDIA NIM). Proven use of AI agents and LLM... ...FedRAMP, SOC 2, or other compliance frameworks relevant to your environment, and red...Senior
$155.42k - $395.9k
...Description About the Team: The ML Inference Platform is part of the AV ML... ...that powers GM’s AI efforts. We’re proud to serve... ...Role: We are seeking a Senior ML Infrastructure engineer to help build and scale robust... ...of-the‑art model serving frameworks, hardware accelerators,...SeniorLocal areaRemote workRelocationRelocation packageFlexible hours- Acceler8 Talent is seeking a Senior / Principal Machine Learning Engineer specializing in inference serving frameworks. This role involves designing and optimizing multi-node inference... ...startup environment to work on cutting-edge AI infrastructure. #J-18808-Ljbffr Acceler8...Senior
$168k - $258.75k
...Product Manager For Ai Platform Recommender Systems At NVIDIA we... ...means we build best in class frameworks in OSS and support a robust... ...Create and optimize pre-training/inference and post-training frameworks... ...Computer Science, Computer Engineering, or similar experience (or...Senior- ...10 years Job Title* and Job band Senior Agentic Platform Engineer Detailed job description - Skill Set... .../CD processes required for reliable AI deployment Mandatory Skills *10 years... ...with data privacy and security frameworks (GDPR, SOC2) as they apply to autonomous...SeniorContract workLocal area
$156.8k - $229.7k
...crossroads. As we ramp up investments in AI-driven product features, the Platform Engineering team is the engine room for this... ...Platforms : Building the frameworks for autonomous AI agents. AI Observability... ...workflows. We are seeking a Senior AI Platform Engineer to lead the...SeniorFull time$148k - $224.25k
...unlimited potential of AI to define the next... ...on to operate inference and agentic... ...Manager to drive NVCF platform features and developer... ...Collaborate with engineering on feature design,... ...and SDKs, agent frameworks. ~ Proven capability... ...to connect with senior technical...Senior$184k - $356.5k
NVIDIA Corporation is seeking a Senior Deep Learning Software Engineer specializing in Inference to join their growing team in... ...accelerated software for advanced AI applications, including... ...high-performance deep learning frameworks like SGLang and vLLM. Candidates...Senior$120.5k - $243k
...Senior Platform Software Engineer This role has been designed as ‘Hybrid’ with an expectation that you will... ...security functions, and underlying SoC SDK or drivers to meet high-performance... ...subsystems. • Preferred: Experience with AI tools for coding assistance (e.g.,...SeniorWork experience placementWork at officeLocal areaImmediate start2 days per week$181.1k - $318.4k
...Senior/Staff Software Engineer - AI, Search & Knowledge Platforms Work Locations (2) Submit Resume The AI, Search & Knowledge... ...and to Private Cloud Compute inference infrastructure. As a member of... ...or similar serialization/RPC frameworks. Experience building CI/CD...SeniorRelocation- ...Senior Cloud Platform Engineer San Jose, California, United States The era of pervasive AI has arrived. In this era, organizations will use... ...focus will be ensuring our inference endpoints have exceptional... ...of model serving frameworks like vLLM, SGLang or Ray....SeniorFull timeTemporary workLocal areaImmediate startFlexible hoursShift work
$224k - $356.5k
...unlimited potential of AI to define the next era of... ...ambitious system software engineer to join the team working on NVIDIA GeForce Now Platform ( The main focus of the... ...developing services and framework-like SDKs, like COM or Windows Runtime SDK Familiarity with...SeniorLocal area$168k - $258.75k
...programs for Deep Learning Training and Inference Frameworks, with the goal of supporting NVIDIA's top AI researchers and software engineers in driving the future of deep learning.... ...evolving roadmap. The TPM will work alongside senior management and coordinate efforts with...SeniorRemote workShift work- ...Building the world’s leading AI-powered, cloud-native... ...’re hiring a Software Engineer to help scale a working... ...a flexible, extensible platform. You’ll design core... ...provider acceptance test framework. Begin HCD connector... ...development — the plugin SDK, resource lifecycle, state...SeniorLocal areaFlexible hours
$152k - $241.5k
...driving advancements in AI and machine... ...talented and motivated engineers to join our... ...leading deep learning inference software for... ...accelerators. As a Senior Software Engineer... ...developing Deep Learning Frameworks, Compilers, or... ...computing platform driving our success...Senior$168k - $270.25k
...Senior Engineer For Factory Infrastructure And Automation NVIDIA is the platform upon which every new AI-powered application is built. We are seeking a senior engineer to... ...infrastructure and automation for NVIDIA Inference Microservices (NIMs). The right person for this role...Senior$212k - $318.4k
...Senior Machine Learning Platform Engineer - AI, Search & Knowledge Work Locations (2) Submit Resume Join us... ...Knowledge platform and the diverse ML frameworks used across Apple, including... ...Serve, TorchServe, TensorRT) or inference optimization Contributions to...SeniorRelocation$128.7k - $261.3k
...Team The Model Deployment & Inference Solutions team in GM AV... ...learning models from training frameworks (e.g. PyTorch) onto autonomous... ...: build the ML deployment platform that makes model rollouts fast... ...performed manually by engineers. Build the developer experience...SeniorLocal areaRemote workWork from homeRelocation packageFlexible hoursShift work$184k - $287.5k
...stack for distributed inference which will be used to... ...the world by applying AI inference aware technology... ...them to AI-Grid platforms and SDKs by providing... ...Computer Science, Electrical Engineering, Software Engineer, or... ...and orchestration frameworks with strong foundation...SeniorWork experience placement$224k - $356.5k
...unlimited potential of AI to define the next... ...world. As a Senior Developer... ...Manager for Data Platforms, you’ll work with... ...business, product, and engineering levels. Build relationships... ...libraries, SDKs, NIMs, and blueprints),... ...LLMs and AI/ML frameworks Experience with...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Platform Engineer, NIM SDK & Framework AI Inference. Be the first to apply!
- platform engineering manager Santa Clara, CA
- platform engineer Santa Clara, CA
- client platform engineer Santa Clara, CA
- platform developer Santa Clara, CA
- data platform engineer Santa Clara, CA
- senior platform engineer Santa Clara, CA
- senior game producer Santa Clara, CA
- senior manager process engineering Santa Clara, CA
- senior manufacturing engineer Santa Clara, CA
- senior manager clinical operations Santa Clara, CA

