Remote Senior GPU Code Gen Engineer for ML Inference
NVIDIA Corporation
- Remote job
NVIDIA Corporation in Santa Clara, CA seeks a Senior Software Engineer for GPU code generation in TensorRT to advance high-performance AI inference on NVIDIA GPUs. You will design and implement advanced GPU code generation techniques and compiler optimizations for diverse models and hardware. Requirements include 4+ years of C++ software development, strong GPU architecture knowledge, and experience with CUDA or MLIR. The role offers hybrid work, competitive salary, and equity benefits. #J-18808-Ljbffr NVIDIA Corporation
$190k - $220k
...As a Senior Inference Engineer at vCluster Labs, you are the first... ...one or more machines on GPU infrastructure, owning... ...with real production code experience. Communication... ...with common ML frameworks (PyTorch, Transformers... ...the globe with a remote-first culture. We...Remote workSeniorFlexible hours$152k - $241.5k
Senior Software Engineer, GPU Code Generation for Machine Learning Inference# CAREERS AT NVIDIA## Senior Software Engineer, GPU Code Generation for Machine Learning InferenceApply: US, CA, Santa Clara: US, CA, Remote: Full time: Posted Today: JR2028415NVIDIA is seeking...Remote workSeniorFull timeLocal area$250k
...next-generation GPU platform designed... ..., and inference at scale. The company... ...is looking for a Senior / Staff Site Reliability Engineer to support and scale... ...with platform, ML, and infrastructure... ...-as-Code tooling such as... ...options Bonus Remote working option and...Remote workSeniorFull time- ...LP in the United States seeks a Senior Software Engineer to design and evolve the model runtime for the AI inference platform, focusing on low tail latency and high GPU utilization on customer-owned... ...week from an HPE office, with remote options considered. #J-18808-Ljbffr...Remote workSeniorWork at office2 days per week
- ...headquartered AI platform, seeks an experienced ML systems engineer to optimize the inference stack across multi-GPU clusters. You’ll tune loaders, schedulers, and KV... ...and distributed setups. The role offers a remote-first global environment and equity options. #J...Remote jobSenior
- ...building large in-house AI/ML infrastructure. Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the... ...We’re looking for a Senior HPC Cluster Engineer to... ...computing. We conduct coding interviews as part of...Remote jobSeniorFull time
$152k - $241.5k
...world.NVIDIA is hiring a Senior Compiler Engineer to join our team... ...the next generation of GPU systems programming. We... ...CUDA PTX and machine code.Build compiler IRs and... ...execution.Expose Next-Gen Hardware Features: Implement... ..., TX, Austin; US, TX, Remote; US, WA, Remote; US,...Remote workSeniorFull time- ...Solutions Architect / Senior Engineer – Gen AI Coding Location: Remote - USA Language Requirement: Fluent in Brazilian Portuguese and English Employment Type... ...and applying foundational concepts in AI, ML, and TDD (Test Driven Development) as appropriate....Remote workSeniorLong term contractLocal area
- Senior Inference SW EngineerThis role has been designed as 'Hybrid... ...a Senior Software Engineer to build and evolve... ...tail latency and high GPU utilization on customer... ...location in the US; however, remote work options will be... ...· Provide insightful code and design reviews,...Remote workSeniorFull timeWork experience placementWork at officeLocal areaImmediate start2 days per week
- vCluster Labs is seeking a Senior Inference Engineer to own the platform's inference layer from the ground... ...scale while building production-grade code in Python or Golang. You’ll work... ...robust, scalable inference across multiple GPU machines. The role emphasizes hands-on...Remote jobSenior
- ...Senior Inference SW Engineer This role has been designed as 'Hybrid' with a requirement... ...low tail latency and high GPU utilization on customer-... ...location in the US; however, remote work options will be considered... ...Provide insightful code and design reviews, mentor team...Remote workSeniorWork experience placementWork at officeLocal area2 days per week
$184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its performance... ....Experience building or directing agentic AI systems — code generation, automated optimization, or multi-step reasoning...SeniorFull time- ...we advance your career. THE ROLE:We are looking for a Senior GPU Inference Performance Engineer to own end-to-end performance analysis of GPU-accelerated... ...Python and C/C++ skills; comfort reading GPU kernel code (HIP/CUDA), runtime code, or systems-level software.Experience...Senior
- ...cloud, and platform engineering teams.... ...Infrastructure as Code, and configuration... ...experience supporting AI/ML platforms, MLOps workflows... ...with model serving, inference optimization, or AI... ...simulations.Experience with GPU-based systems or... ...be performed fully remote, hybrid, or onsite...Remote workSeniorFull timeWork at office
$243.29k - $295.25k
...Infrastructure Foundation Hardware Engineering team, you will play a... ...technical lead for our GPU and AI accelerator... ...-scale rendering and ML workloads run on the... ...rendering and low-latency AI inference.Firmware & Systems:... ...complex server issues remotely, with the ability to...Remote workSeniorFull timeWork experience placementH1bWork at officeLocal areaVisa sponsorshipMonday to Friday- Cerebras Systems is seeking a Software Engineer to productionize and optimize the GPU serving stack, spanning custom inference APIs, the vLLM runtime, ROCm, and rack-scale AMD... ...GPU infrastructure. You will write production code, establish deployment and health-checking...Senior
- ...Senior Site Reliability Engineer Location: Global Remote / San Francisco · Full-Time About... ...research labs, and inference providers when... ...debug large-scale GPU infrastructure used... ...orchestration, and ML frameworks. Drive... ...Infrastructure-as-Code proficiency (Terraform...Remote workSeniorFull time
- AfterQuery is seeking a senior ML Research Engineer to work remotely on inference systems, GPU kernels, and deployment infrastructure. This research-focused contract role emphasizes defining correctness and excellence on problems you know deeply. You will design scenarios...Remote workSeniorContract work
- ...Job Title: Senior CA Gen Engineer Mainframe Modernization Location: Remote Job Type: Contract to Hire W2 Requirements: 5+ years of hands-on experience... ...Strong understanding of CA Gen-generated COBOL code Proven experience with mainframe application modernization...Remote workSeniorContract work
$150k - $220k
...processed more than 20 billion inference requests. We closed a $100M... ...depend on. We're a small, remote-first team. We take ownership... .... We're looking for a ML Systems Engineer, Inference. We want Runpod to... ...single-node and multi-node GPU deployments. - Turn what you...Remote workSeniorFull time$170.1k - $258.3k
...development, and performance engineering so that every cycle on... ...high‑performance GPU kernels and custom... ...heart of our on‑vehicle ML inference for ADAS and autonomous... ...accelerator-backend code across the AV stack.Partner... ...States of America; Remote - Washington; Austin,...Remote workSeniorFull timeLocal areaWork from homeRelocation packageFlexible hours$152k - $241.5k
...computing. An era in which our GPU acts as the brains of... ...searching for a Backend Compiler Engineer for an exciting and fun role in... ...highly desired3+ years of compiler code generation experience (... ...SummaryLocation: US, TX, Austin; US, TX, Remote; US, CA, Remote; US, CA, Santa...Remote workSeniorFull timeWorldwide$162k - $243k
..., Inc. Job Area: Engineering Group, Engineering Group... ...for large-scale LLM inference on Qualcomm platforms.... ...systems AI accelerator or GPU software Cloud-... ...Kubernetes infrastructure ML compiler or runtime... ...discussions, reviewing code, and collaborating with...SeniorWork experience placementWork from home- ...leading training and inference speeds; over 10 times faster than GPU-based hyperscale... ..., hands-on Senior Software Development Engineer in Test (SDET) to... ...engineers through code reviews, debugging... ...Experience with AI/ML infrastructure,... ...per week. Fully remote work is not available...Remote workSeniorWork at office3 days per week
$152k - $241.5k
...searching for a Backend Compiler Engineer for an exciting and fun role in our GPU Software organization. Our Compiler... ...equivalent experience4+ years of compiler code generation experienceExcellent... ...: US, TX, Austin; US, TX, Remote; US, OR, Remote; US, CA, Remote; US...Remote workSeniorFull timeWorldwide$184k - $287.5k
...computing. An era in which our GPU acts as the brains of... ...seeking an AI Compiler Engineer with deep expertise in... ...into compiler passes, code generation flows, and optimization... ...engineering and AI/ML experience, preferably... ...US, TX, Austin; US, TX, Remote; US, CA, Remote; US, WA,...Remote workSeniorFull time- ...are looking for a Senior Computer Vision... ...Learning Engineer to take technical... ...handling, cloud batch inference, and integration... ...an existing ML engineer who owns... ...models through GPU profiling, batch... ...inference optimization, code review, testing,... ...open to fully remote candidates...Remote workSeniorLocal areaVisa sponsorshipFlexible hours
- ...ferment them with good engineering. We started inside... ...we run our own coding harness on any... ...ourselves. Kimchi Inference One API line... ...serverless from our own GPU fleet (OpenAI- and... ...You’ve built real ML systems for 5+... ...Enjoy a flexible, remote-first global environment...Remote workSeniorLocal areaAll shiftsFlexible hours
- Hewlett Packard Enterprise is seeking a Senior Inference Software Engineer to design and evolve the model... ...role focuses on low tail latency, high GPU utilization, and scalable distributed... ...HPE office in the United States, with remote options considered. Strong expertise...Remote workSeniorWork at office2 days per week
$150 per hour
...seeking contributors to run agentic coding sessions on real engineering tasks, analyze the model outputs, and document failures to improve next‑gen coding agents. You will vibe-code with... ...before real users see them. Flexible, remote work; compensation up to $150+ per...Remote jobSeniorHourly payFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Senior GPU Code Gen Engineer for ML Inference. Be the first to apply!
- remote recruitment consultant Santa Clara, CA
- remote video game Santa Clara, CA
- remote typing work Santa Clara, CA
- remote autocad jobs Santa Clara, CA
- remote operation drilling engineer Santa Clara, CA
- customer service rep remote Santa Clara, CA
- remote freelance writer Santa Clara, CA
- remote medical billing part time Santa Clara, CA
- remote ruby on rails developer Santa Clara, CA
- remote security Santa Clara, CA




