Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Engineer - AI Performance & Kernel Optimization

Zyphra

Job Description

Job Description

Zyphra is an artificial intelligence company based in San Francisco, California.

The Role:

As a Research Engineer - AI Performance & Kernel Optimization , you will improve and optimize the performance of our large-scale language model training and inference stacks. You will work closely with our pretraining and inference teams to identify bottlenecks, design and implement highly optimized kernels, and push the limits of throughput, latency, and hardware utilization across a range of accelerator platforms. This role is suited for someone who enjoys deep systems work, cares about performance at every level of the stack, and is excited to translate low-level optimizations into meaningful gains for frontier-scale AI systems.

You’ll Work Across:
  • Kernel development and optimization for large-scale ML workloads, using any level of the stack from PTX/assembly to CUDA, HIP, Triton, or other GPU DSLs

  • Performance tuning for training and inference stacks across GPUs and other accelerators

  • Profiling and eliminating bottlenecks in memory movement, communication, scheduling, and compute utilization

  • Optimizing distributed training and inference systems for large MoE models, including large-scale model parallelism

  • Portability and optimization across non-NVIDIA hardware, with special interest in AMD hardware such as the MI300x and MI355x

  • Collaboration with research and infrastructure teams to turn systems improvements into real-world model training and inference gains

What We're Looking For / Requirements:
  • Strong engineering aptitude for building reliable, high-performance systems

  • Excellent low-level performance intuition and the ability to reason about hardware-software interactions

  • Are excited to rapidly learn new systems, tools, and hardware environments

  • Excellent communication and collaboration skills, with the ability to work effectively across research and engineering teams

  • Enjoy diving deep into the weeds and hunting down the last 10–20% of performance

Qualifications / Additional Skills:
  • Experience writing highly performant GPU kernels at any level of abstraction–PTX, CUDA, HIP, Triton, or other kernel DSLs

  • Experience optimizing ML workloads for large-scale training, ideally in language model pretraining or inference environments

  • Experience with non-NVIDIA accelerator hardware, such as AMD, AWS Trainium, Google TPU, Qualcomm, ARM, Intel, and custom ASICs

  • Strong understanding of distributed training systems and parallelism schemes, including data parallelism, tensor/model parallelism, pipeline parallelism, sharding, and communication/computation overlap

  • Experience with performance engineering in other demanding parallel computing environments such as HPC, quantitative finance, scientific computing, graphics, compilers, or numerical simulation

  • Strong systems intuition around memory hierarchy, bandwidth constraints, kernel fusion, launch overhead, communication overhead, and hardware utilization

  • Experience using profiling and debugging tools to drive performance improvements

  • Familiarity with infrastructure underlying large-scale training and inference, including collective communication libraries, and runtime performance analysis

  • Background in a highly technical field such as physics, mathematics, theoretical computer science, computer science, or electrical engineering

  • Any HPC experience is a strong plus

Why Work at Zyphra:
  • Our research methodology is grounded in methodical, step-by-step approaches to ambitious goals. Both deep research and engineering excellence are equally valued

  • We strongly value new and crazy ideas and are very willing to bet big on new ideas

  • We move as quickly as we can; we aim to minimize the bar to impact as low as possible

  • We all enjoy what we do and love discussing AI

Benefits and Perks:
  • Comprehensive medical, dental, vision, and FSA plans

  • Competitive compensation and 401(k) plan

  • Relocation and immigration support on a case-by-case basis

  • In-office snacks and meals provided

  • Unlimited PTO and company holidays

  • In-person team in San Francisco with a collaborative, high-energy environment

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Research Engineer - AI Performance & Kernel Optimization in San Francisco, CA vacancy
  • $400k

     ...of Thinking Machines is to build AI that extends human will and judgment...  ...’re looking for an infrastructure research engineer to design, optimize, and maintain the compute...  ...model training. You will develop high-performance ML kernels (e.g., CUDA, CuTe, Triton), enable... 
    Performance
    Full time
    Immediate start
    Visa sponsorship
    Work visa
    Relocation package

    thinkingmachines

    San Francisco, CA
    3 days ago
  • $148k - $240k

     ...building a platform where AI and automation co-...  ...discovery Our AI Research team is looking to hire a ML Research Engineer to maximize...  ...but also making these optimizations maintainable, reusable...  ...Building GPU compute performance: profiling, kernel development, long-context... 
    Performance
    Full time
    Work experience placement
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    San Francisco, CA
    3 hours ago
  • $200k - $275k

     ...Description Waabi, founded by AI visionary Raquel...  ...more visit: As a Research Engineer focused on Generative...  ...model graph to GPU kernels and memory movement....  ...as part of performance. Build benchmarks and...  ...every day. Model Optimization and Deployment. You... 
    Performance
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    4 days ago
  • $400k

     ...Machines is to build AI that extends human...  ...We’re looking for engineers to build and...  ...working closely with researchers on the infrastructure...  ...time. You might optimize FP4/FP8 training,...  ...effect on training performance and correctness....  ...precision, FP4/FP8, kernels or compiler work.... 
    Performance
    Full time
    Immediate start
    Visa sponsorship
    Work visa
    Relocation package

    Thinking Machines Lab

    San Francisco, CA
    7 days ago
  • $180k - $290k

     ...that made generative AI accessible to...  ...small, fast growing research lab competing with...  ...into “research” or “engineering.” A promising...  ...hardest systems and performance problems arise: attention...  ..., custom kernels, low-precision training...  ..., communication, optimizer steps,... 
    Performance
    Full time
    Work at office
    2 days per week

    Black Forest Labs

    San Francisco, CA
    7 days ago
  •  ...conversation for every patient. An AI agent that knows who you are...  ...below.About The RoleAs a Research Engineer, you'll be responsible for...  ...models and pipelines that optimize for quality, efficiency, and...  ...for different tasks based on performance, latency, and costPartner... 
    Performance
    Work at office

    Assort Health

    San Francisco, CA
    5 days ago
  •  ...Francisco, California. The Role: As a Research Engineer - Brain Computer Interface Models ,...  ...for EEG and other BCI modalities Performance optimization of the training stack Integration...  ...enjoy what we do and love discussing AI Benefits and Perks:... 
    Performance
    Work at office
    Relocation package

    Zyphra

    San Francisco, CA
    5 days ago
  •  ...Description We are Genmo, a research lab developing the world’s...  ...an exceptional Software Engineer to join our research team in...  ...frontiers of visual generative AI. As a Research Engineer,...  ...GANs, Transformers) Help optimize model performance and scaling capabilities... 
    Performance
    Work at office

    Genmo

    San Francisco, CA
    22 days ago
  •  ...become a massive tax of engineering velocity. Resolve AI is solving this by building...  ...end-to-end, balancing research and engineering to create...  ...ready AI modelsBuild and optimize data pipelines to process...  ...evaluate AI models, improve performance, and reduce compute... 
    Performance
    Work at office

    Resolve AI

    San Francisco, CA
    5 days ago
  • $155k - $269k

     ...Description Waabi, founded by AI visionary Raquel Urtasun, is...  ...efficient simulation. As a Research Engineer in the World Models team,...  ...and inference pipelines. - Optimize model training and inference...  ...incentive awards and an annual performance bonus.   Perks/Benefits:... 
    Performance
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    18 days ago
  •  ...Francisco, California. The Role: As a Research Engineer - Audio & Speech Models , you will...  ...Large-scale audio training runs Performance optimization of our training stack Audio...  ...enjoy what we do and love discussing AI Benefits and Perks: Comprehensive... 
    Performance
    Work at office
    Relocation package

    Zyphra

    San Francisco, CA
    24 days ago
  •  ...Job Description The Role: As a Research Engineer - Vision & Vision-Language Models ,...  ...methodology ablations and improvements Performance optimization of our training and data processing...  ...enjoy what we do and love discussing AI Benefits and Perks:... 
    Performance
    Work at office
    Relocation package

    Zyphra

    San Francisco, CA
    3 days ago
  •  ...Francisco, California. The Role: As a Research Engineer - Language Model Pre-Training , you'...  ...runs and model parallelization Performance optimization of our pretraining stack Dataset...  ...enjoy what we do and love discussing AI Benefits and Perks:... 
    Performance
    Work at office
    Relocation package

    Zyphra

    San Francisco, CA
    17 days ago
  •  ...the demands of advanced AI. AI for Chips connects...  ...work of semiconductor engineering. Our goal is to...  ...cycles. This work brings research, model training, and...  ...correctness and measurable performance at the center....  ..., and physical design optimization. Develop and test approaches... 
    Performance
    Full time

    openai

    San Francisco, CA
    3 days ago
  •  ...interpretable, and steerable AI systems. We want AI to be...  ...growing group of committed researchers, engineers, policy experts, and business...  ...through profiling, optimization, and benchmarking Make the...  ...profiling and optimizing the performance of ML workloads Experience... 
    Performance
    Work at office
    Local area
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    7 days ago
  •  ...discovery programs. AI is reinventing life sciences...  ...reinvented software engineering, and our team is...  ...role Make our models performant, fast, and reliable...  ...working closely with researchers on experiments to...  ...parallelism, quantization, kernel optimization and whatever else... 
    Performance
    Full time

    chaidiscovery

    San Francisco, CA
    3 days ago
  • $200k - $290k

     ...Shaping team at Together AI works on products and research for tailoring open...  .... As a Research Engineer on the Scaling Team within...  ...into robust, high-performance systems. You will profile and optimize Together's training...  ...optimized NVIDIA GPU kernels using CUDA or Triton,... 
    Performance
    Full time

    Together AI

    San Francisco, CA
    3 hours ago
  •  ...Research Engineer, Code RL (Reinforcement Learning) About Anthropic...  ..., and steerable AI systems. We want AI to...  ...engineering, to high-performance code for accelerators...  ...performance profiling and optimization of ML systems CUDA / GPU or TPU kernel experience and... 
    Performance
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    3 days ago
  •  ...infrastructure frontier AI labs build...  ...secure sandboxes, high-performance training, and...  ...tasks like autonomous research, and the full-...  ...lengths grow. Optimize multi-node MoE inference...  ...of inference-engine internals. Strong...  ...CUDA or Triton kernel work, particularly... 
    Performance
    Full time
    Work at office
    Remote work
    Visa sponsorship
    Relocation package
    Flexible hours

    PrimeIntellect

    San Francisco, CA
    3 days ago
  •  ...infrastructure frontier AI labs build...  ...secure sandboxes, high-performance training, and...  ...tasks like autonomous research, and the full-...  ...Impact Build and optimize the distributed training...  ..., including kernels, communication paths...  ...infrastructure engineers to translate bottlenecks... 
    Performance
    Full time
    Work at office
    Remote work
    Visa sponsorship
    Relocation package
    Flexible hours

    PrimeIntellect

    San Francisco, CA
    3 days ago
  •  ...interpretable, and steerable AI systems. We want AI to be...  ...growing group of committed researchers, engineers, policy experts, and business...  ..., data processing, and optimizer development - Independently...  ...Experience - Work on high-performance, large-scale ML systems - Familiarity... 
    Performance
    Full time

    Anthropic

    San Francisco, CA
    13 days ago
  •  ...We are an applied AI lab building end-to-end software agents...  ..., the first AI software engineer. Our team is extremely talent...  ...join us. Role Mission Research moves at the speed of the...  ...largest RL training scales. Performance Optimization: Profile and improve... 
    Performance
    Full time
    Local area

    Cognition

    San Francisco, CA
    7 days ago
  •  ...infrastructure frontier AI labs build internally,...  ...sandboxes, high-performance training, and deployment...  ...tasks like autonomous research, and the full-stack platform...  ...We’re hiring research engineers and scientists across...  ...objectives and policy optimization. Investigate... 
    Performance
    Full time
    Work at office
    Remote work
    Visa sponsorship
    Relocation package
    Flexible hours

    PrimeIntellect

    San Francisco, CA
    3 days ago
  • $150 per hour

     ...technical talent with leading AI research labs. Headquartered in San...  ...machine learning engineering tasks in a long-horizon AI...  ...training, fine-tuning, or optimizing models in PyTorch or JAX...  ...LLMs , GPU inference and performance , Reinforcement learning... 
    Performance
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    21 days ago
  • $200k - $225k

     ...AlembicAlembic is where top engineers are solving marketing'...  ...analyticsDocument research and implementation...  ...statistics, probability, optimization, causal...  ...with GPU computing and performance optimizationUnderstanding...  ...technology: Work with advanced AI/ML algorithms, composite... 
    Performance

    Alembic

    San Francisco, CA
    4 days ago
  •  ...platform for customer-facing AI agents, working with...  ...Labs.Sierra’s Applied Research team advances the...  ...learning and long-horizon optimization.Build rigorous...  ...evaluations that connect model performance to real-world agent...  ...TypeOn-siteDepartmentEngineeringPlatform Engineering
    Performance
    Full time
    Local area
    Flexible hours

    Sierra

    San Francisco, CA
    2 days ago
  • $400k

     ...Thinking Machines is to build AI that extends human will and...  ...for an infrastructure research engineer to design and build the core...  ...from precision formats and kernel optimizations to communication frameworks...  ...large-scale LLMs, focusing on performance, stability, and... 
    Performance
    Full time
    Immediate start
    Visa sponsorship
    Work visa
    Relocation package

    thinkingmachines

    San Francisco, CA
    3 days ago
  •  ...interpretable, and steerable AI systems. We want AI...  ...group of committed researchers, engineers, policy experts, and...  ...Own end-to-end performance of our largest RL runs...  ...behavior of large-scale optimization Hands-on...  ...before anyone writes the kernel The annual compensation... 
    Performance
    Work at office
    Local area
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    3 hours ago
  •  ...We're building a research cohort of senior domain experts in ML inference and GPU kernel engineering — spanning inference serving systems, kernel optimization, and large-model deployment infrastructure — to help evaluate how frontier AI models reason about hard, real-world... 
    Contract work

    AfterQuery

    San Francisco, CA
    a month ago
  • $58 - $70 per hour

     ...Role Overview As a Systems Research Engineer Intern specialized in GPU Programming...  ...role in developing and optimizing GPU-accelerated kernels and algorithms for ML/AI applications. Working closely...  ...model architecture to enhance the performance and efficiency of our AI... 
    Performance
    Hourly pay
    Summer work
    Internship

    Together AI

    San Francisco, CA
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Engineer - AI Performance & Kernel Optimization. Be the first to apply!