Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

GPU Kernel Engineer

Full-time

Sciforium

Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.

About the role

We are seeking a highly skilled GPU Kernel Engineer who is passionate about pushing the limits of performance on modern accelerators. In this role, you will design and optimize custom GPU kernels that power next-generation large-scale AI systems. You will work across the hardware–software stack, from low-level kernel development to integrating optimized ops into high-level ML frameworks used for large-scale training and inference.


This role is ideal for someone who thrives at the intersection of GPU programming, systems engineering, and cutting-edge AI workloads, and who wants to make meaningful contributions to the efficiency and scalability of our ML platform.

 

Key Responsibilities

  • Design, implement, and optimize custom GPU kernels using C++, PTX, CUDA, ROCm, Triton, and/or JAX Pallas.

  • Profile and optimize end-to-end performance of ML operations, with a focus on large-scale LLM training and inference.

  • Integrate low-level GPU kernels into frameworks such as PyTorch, JAX, and custom internal runtimes.

  • Develop performance models, identify bottlenecks, and deliver kernel-level improvements that significantly accelerate AI workloads.

  • Collaborate with ML researchers, distributed systems engineers, and model-serving teams to optimize compute performance across the stack.

  • Work closely with hardware vendors (NVIDIA/AMD) and stay current on the latest GPU architecture capabilities and compiler/toolchain improvements.

  • Contribute to tooling, documentation, benchmarking suites, and testing frameworks to ensure correctness and performance reproducibility.

 

Must-Haves

  • 5+ years of industry or research experience in GPU kernel development or high-performance computing.

  • Bachelor’s, Master’s, or PhD in Computer Science, Computer Engineering, Electrical Engineering, Applied Mathematics, or a related field.

  • Strong programming skills in C++, Python, and familiarity with ML frameworks.

  • Deep expertise in CUDA/ROCm, GPU memory models, and performance optimization strategies.

  • Hands-on experience with Triton and/or JAX Pallas for custom kernel development.

  • Strong understanding of PTX, GPU ASM, and low-level GPU execution.

  • Extensive experience writing and optimizing custom GPU kernels in C++ and PTX.

  • Proven ability to integrate low-level kernels into PyTorch, JAX, or similar frameworks.

  • Experience working with large-scale LLM workloads (training or inference).

 

Nice-to-Haves

  • Experience with AMD GPUs and ROCm optimization.

  • Familiarity with JAX FFI and custom ML operator development.

  • Experience with efficient model serving frameworks (e.g., vLLM, TensorRT).

  • Experience with TPUs, XLA, or similar accelerator programming environments.

  • Contributions to open-source ML systems, compilers, or GPU kernels.

Benefits include

  • Medical, dental, and vision insurance

  • 401k plan

  • Daily lunch, snacks, and beverages

  • Flexible time off

  • Competitive salary and equity

Equal opportunity

Sciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the GPU Kernel Engineer in San Francisco, CA vacancy
  •  ...About the job FriendliAI is looking for a GPU Kernel Engineer to design, build, and optimize the low-level compute kernels that power our large-scale, GPU-accelerated AI inference platform. You will be delivering world-class inference speed across NVIDIA and AMD GPUs... 
    Suggested
    Full time
    Worldwide
    Flexible hours

    friendliai

    San Francisco, CA
    4 days ago
  •  ...hybrid role spans across platform reliability and infrastructure engineering. You'll be instrumental in ensuring high availability, fault...  ...and performance across internal research and external customers' GPU cluster environments. Responsibilities include automating GPU... 
    Suggested

    Macpower Digital Assets Edge Private Limited

    San Francisco, CA
    21 days ago
  •  ...robots to learn and act in a changing world. We're seeking a GPU Performance Engineer to squeeze every last FLOP from our H100 infrastructure and...  ...that achieve 5-10x speedups. From writing custom CUDA kernels to eliminating cold start latency, you'll ensure our infrastructure... 
    Suggested

    Genmo

    San Francisco, CA
    16 days ago
  •  ...inference cloud. Customers send us requests, we run them on our own GPU fleet around the world, and we compete on price, speed and...  ...CUDA experience. We’d rather have an excellent low-level systems engineer with no GPU background than an average CUDA programmer. What... 
    Suggested
    Full time

    relace

    San Francisco, CA
    4 days ago
  •  ...earned by shipping excellence. We seek engineers with strong intrinsic drive, a true...  ...of high-performance systems to optimize GPU performance at the bleeding edge of AI....  ...Responsibilities Design and optimize GPU kernels and tensor libraries Translate HPC techniques... 
    Suggested
    Full time
    Work at office

    vastai

    San Francisco, CA
    4 days ago
  •  ...leadership is earned by shipping excellence. We seek engineers with strong intrinsic drive, a true passion for...  ...Los Angeles. About the Role As a systems/GPU engineer, you will play a crucial role in developing new kernels and algorithms that can improve inference for... 
    Full time
    Work at office

    vastai

    San Francisco, CA
    4 days ago
  • $200k - $300k

     ...About the Role As a Systems Research Engineer specialized in GPU Programming, you will play a crucial role in developing and optimizing GPU-accelerated kernels and algorithms for ML/AI applications. Working closely with the modeling and algorithm team, you will co-... 
    Full time
    Remote work

    Together AI

    San Francisco, CA
    1 day ago
  • $200k - $400k

     ...Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster...  ...years to build. About the Role We're looking for an AMD GPU kernel engineer to make vLLM a first-class inference engine across the... 
    Full time
    Remote work
    Visa sponsorship

    inferact

    San Francisco, CA
    4 days ago
  • $250k

     ...scaling AI cloud infrastructure provider building a next-generation GPU platform designed for AI training, experimentation, and...  ...The company is looking for a Senior / Staff Site Reliability Engineer to support and scale large-scale HPC and cloud environments powering... 
    Full time
    Remote work
    San Francisco, CA
    more than 2 months ago
  • $170k - $250k

     ...within six months and is scaling rapidly with a small, high-performing team. This company is looking for an engineer to work directly with the CTO on complex GPU virtualisation challenges. The role offers hands-on involvement with a production platform, providing the... 
    Full time
    Visa sponsorship
    Flexible hours
    San Francisco, CA
    more than 2 months ago
  • $135.2k - $306.4k

     ...positionApplicants are required to read, write, and speak the following languages: EnglishOracle hardware platform development engineering is seeking a highly driven GPU/CPU Platform System Engineer at the Principal Engineer level. The GPU System Engineer will work within... 
    Temporary work
    Work experience placement
    Remote work
    Flexible hours

    Oracle Corporation

    San Francisco, CA
    23 hours ago
  •  ...sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the...  ...About the Role We are looking for a GPU Cluster Engineer to own the entire software stack of our GPU clusters — from kernel tuning and GPU drivers up through... 
    Full time
    Flexible hours

    Sciforium

    San Francisco, CA
    4 days ago
  •  ...We're building a research cohort of senior domain experts in ML inference and GPU kernel engineering — spanning inference serving systems, kernel optimization, and large-model deployment infrastructure — to help evaluate how frontier AI models reason about hard, real-... 
    Contract work

    AfterQuery

    San Francisco, CA
    a month ago
  • $250k - $300k

     ...the Role: As a Senior Staff Automation Engineer for the Compute Team, you will be...  ...testing automation of large-scale, multi-node GPU clusters. You will own the CI/CD infrastructure...  ...System Internals: Knowledge of Linux kernel internals, specifically PCIe topology, VFIO... 
    Temporary work

    Crusoe

    San Francisco, CA
    6 days ago
  •  ... Specter is hiring a Software Systems Engineer to build the real-time device software at...  ...profile and benchmark system performance — CPU/GPU utilization, memory pressure, network...  ...sensors — including driver interfaces, kernel boundaries, and video pipelines (capture,... 
    Full time

    specter

    San Francisco, CA
    4 days ago
  •  ...Francisco, California. The Role: As a Research Engineer - AI Performance & Kernel Optimization , you will improve and optimize the performance...  ...stack from PTX/assembly to CUDA, HIP, Triton, or other GPU DSLs Performance tuning for training and inference... 
    Full time
    Work at office
    Relocation package

    zyphra

    San Francisco, CA
    4 days ago
  • $400k

     ...lasting days or weeks. We’re looking for engineers to build and improve those systems, working...  ...training frameworks, parallelism, GPU communication, low-precision training, runtime...  ...through profiling, mixed precision, FP4/FP8, kernels or compiler work. Developing NCCL or... 
    Full time
    Immediate start
    Visa sponsorship
    Work visa
    Relocation package

    Thinking Machines Lab

    San Francisco, CA
    8 days ago
  •  ...Overview We are looking for a Performance Engineer to make World Labs’ models train and...  ...problem. You will find the bottlenecks — in kernels, in the serving path, in the training...  ...efficiently at production scale. Write and tune GPU kernels (CUDA, Triton) for hot paths;... 
    Full time
    Work at office
    Visa sponsorship
    Work visa
    Relocation package
    Flexible hours

    worldlabs

    San Francisco, CA
    4 days ago
  •  ...Francisco. ABOUT THE ROLE You'll write and optimize the GPU kernels and supporting systems software that makes our training and...  ...shapes and patterns our models actually use. We hire kernel engineers because the gap between "this works" and "this is fast on the... 
    Full time
    Shift work

    makermaker.ai

    San Francisco, CA
    4 days ago
  • $300 per unit

     ..., Larry Summers , and Jack Dorsey . Position: CUDA Engineering Expert Type: Contract Compensation: $300 per task...  ...Remote Role Responsibilities Analyze and optimize GPU kernels for performance, efficiency, and hardware utilization.... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    1 day ago
  •  ...seeking a Senior/Staff Rendering Systems Engineer to build and scale high-throughput, Unreal...  ...You will own the low-level rendering and GPU performance work required to run many-...  ...optimization skills (CUDA/Vulkan), with emphasis on kernel-level tuning, memory hierarchy management... 
    Full time
    Work at office
    Visa sponsorship
    Work visa
    Relocation package
    Flexible hours

    worldlabs

    San Francisco, CA
    4 days ago
  • $350k

     ...training and inference across global cloud and GPU environments. The organization partners...  ...is for a Staff Site Reliability Engineer to lead the reliability of large-scale GPU...  ...Strong Linux systems expertise, including kernel tuning, CUDA lifecycle management, cgroups... 
    Full time
    San Francisco, CA
    more than 2 months ago
  • $215k - $260k

     ...About the Role: The Crusoe Cloud Software Development team is seeking a passionate and experienced Staff Software Engineer specializing in Linux Kernel Security. This critical role is essential in strengthening the security posture of our core Linux kernel and... 
    Full time
    Temporary work

    Crusoe

    San Francisco, CA
    12 days ago
  • $182k - $242k

     ...underneath them. As a Senior Specialist Field Engineer for Security, you'll help those customers...  ..., identity, and compliance on large GPU clusters, from the hardware up through Kubernetes...  ...across hardware, firmware, the Linux kernel, the network, and Kubernetes. Find... 
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    San Francisco, CA
    4 days ago
  • $170k - $205k

     ...the Role:As a Senior Deployment Automation Engineer for the Compute Team, you will be...  ...testing automation of large-scale, multi-node GPU clusters. You will develop the CI/CD infrastructure...  ....System Internals: Knowledge of Linux kernel internals, specifically PCIe topology,... 
    Temporary work

    Crusoe

    San Francisco, CA
    5 days ago
  •  ...At Liquid AI, we’re building novel model architectures that require GPU performance engineering beyond what standard frameworks can deliver. You’ll design, implement, and optimize custom GPU kernels that make our models faster and more efficient across training, post... 
    Full time

    liquid-ai

    San Francisco, CA
    4 days ago
  • $250k - $300k

     ...the technical direction for Crusoe's Linux kernel team, owning the roadmap and architecting...  ...problems while mentoring and growing the engineers around you to deliver production-ready...  ...management, scheduler, networking, storage, and GPU-related subsystems Design and... 
    Temporary work

    Crusoe

    San Francisco, CA
    6 days ago
  •  ...give everyone the power of superintelligence. One person, one GPU. If you'd like to build the world's best AI cloud, join us....  ...with electrical systems, controls, building structure, hardware engineering, construction, commissioning, and operations. Support equipment... 
    Full time
    Work at office
    Local area
    Work from home
    Flexible hours

    Lambda

    San Francisco, CA
    8 days ago
  •  ...experienced AI Factory Platform Operations Engineer one of a client to support deployment,...  ...monitoring, and operational support of AI/GPU environments. The engineer will work...  ...Rocky Linux and Ubuntu. Troubleshoot OS, kernel, storage, networking, services, and application... 

    Accrescent Group

    San Francisco, CA
    25 days ago
  •  ...benefits all of humanity, our team combines world-class researchers, engineers, designers, and operators who care deeply about creating useful...  ...consumer devices and the platforms behind them. We connect kernel development with the broader software stack to deliver complete... 
    Full time

    OpenAI

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to GPU Kernel Engineer. Be the first to apply!