Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote Senior GPU Code Gen Engineer for ML Inference

NVIDIA Corporation

Santa Clara, CA
  • Remote job

NVIDIA Corporation in Santa Clara, CA seeks a Senior Software Engineer for GPU code generation in TensorRT to advance high-performance AI inference on NVIDIA GPUs. You will design and implement advanced GPU code generation techniques and compiler optimizations for diverse models and hardware. Requirements include 4+ years of C++ software development, strong GPU architecture knowledge, and experience with CUDA or MLIR. The role offers hybrid work, competitive salary, and equity benefits. #J-18808-Ljbffr NVIDIA Corporation

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote Senior GPU Code Gen Engineer for ML Inference in Santa Clara, CA vacancy
  • $190k - $220k

     ...As a Senior Inference Engineer at vCluster Labs, you are the first...  ...one or more machines on GPU infrastructure, owning...  ...with real production code experience. Communication...  ...with common ML frameworks (PyTorch, Transformers...  ...the globe with a remote-first culture. We... 
    Remote work
    Senior
    Flexible hours

    Vcluster

    San Francisco, CA
    2 days ago
  • $152k - $241.5k

    Senior Software Engineer, GPU Code Generation for Machine Learning Inference# CAREERS AT NVIDIA## Senior Software Engineer, GPU Code Generation for Machine Learning InferenceApply: US, CA, Santa Clara: US, CA, Remote: Full time: Posted Today: JR2028415NVIDIA is seeking... 
    Remote work
    Senior
    Full time
    Local area

    NVIDIA Corporation

    Santa Clara, CA
    1 day ago
  • $250k

     ...next-generation GPU platform designed...  ..., and inference at scale. The company...  ...is looking for a Senior / Staff Site Reliability Engineer to support and scale...  ...with platform, ML, and infrastructure...  ...-as-Code tooling such as...  ...options Bonus  Remote working option and... 
    Remote work
    Senior
    Full time
    San Francisco, CA
    more than 2 months ago
  •  ...LP in the United States seeks a Senior Software Engineer to design and evolve the model runtime for the AI inference platform, focusing on low tail latency and high GPU utilization on customer-owned...  ...week from an HPE office, with remote options considered. #J-18808-Ljbffr... 
    Remote work
    Senior
    Work at office
    2 days per week

    Hewlett Packard Enterprise

    Spring, Montgomery County, TX
    2 days ago
  •  ...headquartered AI platform, seeks an experienced ML systems engineer to optimize the inference stack across multi-GPU clusters. You’ll tune loaders, schedulers, and KV...  ...and distributed setups. The role offers a remote-first global environment and equity options. #J... 
    Remote job
    Senior

    CAST AI Group

    Miami, FL
    1 day ago
  •  ...building large in-house AI/ML infrastructure. Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the...  ...We’re looking for a Senior HPC Cluster Engineer to...  ...computing. We conduct coding interviews as part of... 
    Remote job
    Senior
    Full time

    Nebius

    Remote
    1 day ago
  • $152k - $241.5k

     ...world.NVIDIA is hiring a Senior Compiler Engineer to join our team...  ...the next generation of GPU systems programming. We...  ...CUDA PTX and machine code.Build compiler IRs and...  ...execution.Expose Next-Gen Hardware Features: Implement...  ..., TX, Austin; US, TX, Remote; US, WA, Remote; US,... 
    Remote work
    Senior
    Full time

    Nvidia

    Austin, TX
    4 days ago
  •  ...Solutions Architect / Senior Engineer – Gen AI Coding Location: Remote - USA Language Requirement: Fluent in Brazilian Portuguese and English Employment Type...  ...and applying foundational concepts in AI, ML, and TDD (Test Driven Development) as appropriate.... 
    Remote work
    Senior
    Long term contract
    Local area

    Saviance

    United States
    20 hours ago
  • Senior Inference SW EngineerThis role has been designed as 'Hybrid...  ...a Senior Software Engineer to build and evolve...  ...tail latency and high GPU utilization on customer...  ...location in the US; however, remote work options will be...  ...· Provide insightful code and design reviews,... 
    Remote work
    Senior
    Full time
    Work experience placement
    Work at office
    Local area
    Immediate start
    2 days per week

    Hewlett Packard Enterprise

    Durham, NC
    5 days ago
  • vCluster Labs is seeking a Senior Inference Engineer to own the platform's inference layer from the ground...  ...scale while building production-grade code in Python or Golang. You’ll work...  ...robust, scalable inference across multiple GPU machines. The role emphasizes hands-on... 
    Remote job
    Senior

    Vcluster

    San Francisco, CA
    1 day ago
  •  ...Senior Inference SW Engineer This role has been designed as 'Hybrid' with a requirement...  ...low tail latency and high GPU utilization on customer-...  ...location in the US; however, remote work options will be considered...  ...Provide insightful code and design reviews, mentor team... 
    Remote work
    Senior
    Work experience placement
    Work at office
    Local area
    2 days per week

    Hewlett Packard Enterprise

    Spring, Montgomery County, TX
    20 hours ago
  • $184k - $287.5k

    We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its performance...  ....Experience building or directing agentic AI systems — code generation, automated optimization, or multi-step reasoning... 
    Senior
    Full time

    Nvidia

    Seattle, WA
    3 days ago
  •  ...we advance your career. THE ROLE:We are looking for a Senior GPU Inference Performance Engineer to own end-to-end performance analysis of GPU-accelerated...  ...Python and C/C++ skills; comfort reading GPU kernel code (HIP/CUDA), runtime code, or systems-level software.Experience... 
    Senior

    AMD

    Santa Clara, CA
    6 days ago
  •  ...cloud, and platform engineering teams....  ...Infrastructure as Code, and configuration...  ...experience supporting AI/ML platforms, MLOps workflows...  ...with model serving, inference optimization, or AI...  ...simulations.Experience with GPU-based systems or...  ...be performed fully remote, hybrid, or onsite... 
    Remote work
    Senior
    Full time
    Work at office

    Applied Research Associates

    Raleigh, NC
    3 days ago
  • $243.29k - $295.25k

     ...Infrastructure Foundation Hardware Engineering team, you will play a...  ...technical lead for our GPU and AI accelerator...  ...-scale rendering and ML workloads run on the...  ...rendering and low-latency AI inference.Firmware & Systems:...  ...complex server issues remotely, with the ability to... 
    Remote work
    Senior
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Visa sponsorship
    Monday to Friday

    Roblox

    San Mateo, CA
    2 days ago
  • Cerebras Systems is seeking a Software Engineer to productionize and optimize the GPU serving stack, spanning custom inference APIs, the vLLM runtime, ROCm, and rack-scale AMD...  ...GPU infrastructure. You will write production code, establish deployment and health-checking... 
    Senior

    Cerebras

    Sunnyvale, CA
    20 hours ago
  •  ...Senior Site Reliability Engineer Location: Global Remote / San Francisco · Full-Time About...  ...research labs, and inference providers when...  ...debug large-scale GPU infrastructure used...  ...orchestration, and ML frameworks. Drive...  ...Infrastructure-as-Code proficiency (Terraform... 
    Remote work
    Senior
    Full time

    Andromeda Cluster, Inc

    United States
    2 days ago
  • AfterQuery is seeking a senior ML Research Engineer to work remotely on inference systems, GPU kernels, and deployment infrastructure. This research-focused contract role emphasizes defining correctness and excellence on problems you know deeply. You will design scenarios... 
    Remote work
    Senior
    Contract work

    AfterQuery

    Cleveland, OH
    20 hours ago
  •  ...Job Title: Senior CA Gen Engineer Mainframe Modernization Location: Remote Job Type: Contract to Hire W2 Requirements: 5+ years of hands-on experience...  ...Strong understanding of CA Gen-generated COBOL code Proven experience with mainframe application modernization... 
    Remote work
    Senior
    Contract work

    NasTech Global, Inc.

    United States
    20 hours ago
  • $150k - $220k

     ...processed more than 20 billion inference requests. We closed a $100M...  ...depend on. We're a small, remote-first team. We take ownership...  .... We're looking for a ML Systems Engineer, Inference. We want Runpod to...  ...single-node and multi-node GPU deployments. - Turn what you... 
    Remote work
    Senior
    Full time

    Runpod

    Remote
    29 days ago
  • $170.1k - $258.3k

     ...development, and performance engineering so that every cycle on...  ...high‑performance GPU kernels and custom...  ...heart of our on‑vehicle ML inference for ADAS and autonomous...  ...accelerator-backend code across the AV stack.Partner...  ...States of America; Remote - Washington; Austin,... 
    Remote work
    Senior
    Full time
    Local area
    Work from home
    Relocation package
    Flexible hours

    General Motors

    San Francisco, CA
    2 days ago
  • $152k - $241.5k

     ...computing. An era in which our GPU acts as the brains of...  ...searching for a Backend Compiler Engineer for an exciting and fun role in...  ...highly desired3+ years of compiler code generation experience (...  ...SummaryLocation: US, TX, Austin; US, TX, Remote; US, CA, Remote; US, CA, Santa... 
    Remote work
    Senior
    Full time
    Worldwide

    Nvidia

    Santa Clara, CA
    5 days ago
  • $162k - $243k

     ..., Inc. Job Area: Engineering Group, Engineering Group...  ...for large-scale LLM inference on Qualcomm platforms....  ...systems AI accelerator or GPU software Cloud-...  ...Kubernetes infrastructure ML compiler or runtime...  ...discussions, reviewing code, and collaborating with... 
    Senior
    Work experience placement
    Work from home

    QUALCOMM, Inc.

    Santa Clara, CA
    2 days ago
  •  ...leading training and inference speeds; over 10 times faster than GPU-based hyperscale...  ..., hands-on Senior Software Development Engineer in Test (SDET) to...  ...engineers through code reviews, debugging...  ...Experience with AI/ML infrastructure,...  ...per week. Fully remote work is not available... 
    Remote work
    Senior
    Work at office
    3 days per week

    Cerebras Systems

    Sunnyvale, CA
    2 days ago
  • $152k - $241.5k

     ...searching for a Backend Compiler Engineer for an exciting and fun role in our GPU Software organization. Our Compiler...  ...equivalent experience4+ years of compiler code generation experienceExcellent...  ...: US, TX, Austin; US, TX, Remote; US, OR, Remote; US, CA, Remote; US... 
    Remote work
    Senior
    Full time
    Worldwide

    Nvidia

    Austin, TX
    2 days ago
  • $184k - $287.5k

     ...computing. An era in which our GPU acts as the brains of...  ...seeking an AI Compiler Engineer with deep expertise in...  ...into compiler passes, code generation flows, and optimization...  ...engineering and AI/ML experience, preferably...  ...US, TX, Austin; US, TX, Remote; US, CA, Remote; US, WA,... 
    Remote work
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    6 days ago
  •  ...are looking for a Senior Computer Vision...  ...Learning Engineer to take technical...  ...handling, cloud batch inference, and integration...  ...an existing ML engineer who owns...  ...models through GPU profiling, batch...  ...inference optimization, code review, testing,...  ...open to fully remote candidates... 
    Remote work
    Senior
    Local area
    Visa sponsorship
    Flexible hours

    illumicell AI

    San Francisco, CA
    1 day ago
  •  ...ferment them with good engineering. We started inside...  ...we run our own coding harness on any...  ...ourselves. Kimchi Inference One API line...  ...serverless from our own GPU fleet (OpenAI- and...  ...You’ve built real ML systems for 5+...  ...Enjoy a flexible, remote-first global environment... 
    Remote work
    Senior
    Local area
    All shifts
    Flexible hours

    CAST AI Group

    Miami, FL
    2 days ago
  • Hewlett Packard Enterprise is seeking a Senior Inference Software Engineer to design and evolve the model...  ...role focuses on low tail latency, high GPU utilization, and scalable distributed...  ...HPE office in the United States, with remote options considered. Strong expertise... 
    Remote work
    Senior
    Work at office
    2 days per week

    Hewlett Packard Enterprise Company

    Spring, Montgomery County, TX
    2 days ago
  • $150 per hour

     ...seeking contributors to run agentic coding sessions on real engineering tasks, analyze the model outputs, and document failures to improve next‑gen coding agents. You will vibe-code with...  ...before real users see them. Flexible, remote work; compensation up to $150+ per... 
    Remote job
    Senior
    Hourly pay
    Flexible hours

    DataAnnotation

    Mckinney, TX
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Senior GPU Code Gen Engineer for ML Inference. Be the first to apply!