Research Engineer - AI Performance & Kernel Optimization
Zyphra
Job Description
Job Description
Zyphra is an artificial intelligence company based in San Francisco, California.
The Role:As a Research Engineer - AI Performance & Kernel Optimization , you will improve and optimize the performance of our large-scale language model training and inference stacks. You will work closely with our pretraining and inference teams to identify bottlenecks, design and implement highly optimized kernels, and push the limits of throughput, latency, and hardware utilization across a range of accelerator platforms. This role is suited for someone who enjoys deep systems work, cares about performance at every level of the stack, and is excited to translate low-level optimizations into meaningful gains for frontier-scale AI systems.
You’ll Work Across:Kernel development and optimization for large-scale ML workloads, using any level of the stack from PTX/assembly to CUDA, HIP, Triton, or other GPU DSLs
Performance tuning for training and inference stacks across GPUs and other accelerators
Profiling and eliminating bottlenecks in memory movement, communication, scheduling, and compute utilization
Optimizing distributed training and inference systems for large MoE models, including large-scale model parallelism
Portability and optimization across non-NVIDIA hardware, with special interest in AMD hardware such as the MI300x and MI355x
Collaboration with research and infrastructure teams to turn systems improvements into real-world model training and inference gains
Strong engineering aptitude for building reliable, high-performance systems
Excellent low-level performance intuition and the ability to reason about hardware-software interactions
Are excited to rapidly learn new systems, tools, and hardware environments
Excellent communication and collaboration skills, with the ability to work effectively across research and engineering teams
Enjoy diving deep into the weeds and hunting down the last 10–20% of performance
Experience writing highly performant GPU kernels at any level of abstraction–PTX, CUDA, HIP, Triton, or other kernel DSLs
Experience optimizing ML workloads for large-scale training, ideally in language model pretraining or inference environments
Experience with non-NVIDIA accelerator hardware, such as AMD, AWS Trainium, Google TPU, Qualcomm, ARM, Intel, and custom ASICs
Strong understanding of distributed training systems and parallelism schemes, including data parallelism, tensor/model parallelism, pipeline parallelism, sharding, and communication/computation overlap
Experience with performance engineering in other demanding parallel computing environments such as HPC, quantitative finance, scientific computing, graphics, compilers, or numerical simulation
Strong systems intuition around memory hierarchy, bandwidth constraints, kernel fusion, launch overhead, communication overhead, and hardware utilization
Experience using profiling and debugging tools to drive performance improvements
Familiarity with infrastructure underlying large-scale training and inference, including collective communication libraries, and runtime performance analysis
Background in a highly technical field such as physics, mathematics, theoretical computer science, computer science, or electrical engineering
Any HPC experience is a strong plus
Our research methodology is grounded in methodical, step-by-step approaches to ambitious goals. Both deep research and engineering excellence are equally valued
We strongly value new and crazy ideas and are very willing to bet big on new ideas
We move as quickly as we can; we aim to minimize the bar to impact as low as possible
We all enjoy what we do and love discussing AI
Comprehensive medical, dental, vision, and FSA plans
Competitive compensation and 401(k) plan
Relocation and immigration support on a case-by-case basis
In-office snacks and meals provided
Unlimited PTO and company holidays
In-person team in San Francisco with a collaborative, high-energy environment
$400k
...of Thinking Machines is to build AI that extends human will and judgment... ...’re looking for an infrastructure research engineer to design, optimize, and maintain the compute... ...model training. You will develop high-performance ML kernels (e.g., CUDA, CuTe, Triton), enable...PerformanceFull timeImmediate startVisa sponsorshipWork visaRelocation package$148k - $240k
...building a platform where AI and automation co-... ...discovery Our AI Research team is looking to hire a ML Research Engineer to maximize... ...but also making these optimizations maintainable, reusable... ...Building GPU compute performance: profiling, kernel development, long-context...PerformanceFull timeWork experience placementWork at officeLocal areaFlexible hours$200k - $275k
...Description Waabi, founded by AI visionary Raquel... ...more visit: As a Research Engineer focused on Generative... ...model graph to GPU kernels and memory movement.... ...as part of performance. Build benchmarks and... ...every day. Model Optimization and Deployment. You...PerformanceFull timeWork at officeWork from homeFlexible hours$400k
...Machines is to build AI that extends human... ...We’re looking for engineers to build and... ...working closely with researchers on the infrastructure... ...time. You might optimize FP4/FP8 training,... ...effect on training performance and correctness.... ...precision, FP4/FP8, kernels or compiler work....PerformanceFull timeImmediate startVisa sponsorshipWork visaRelocation package$180k - $290k
...that made generative AI accessible to... ...small, fast growing research lab competing with... ...into “research” or “engineering.” A promising... ...hardest systems and performance problems arise: attention... ..., custom kernels, low-precision training... ..., communication, optimizer steps,...PerformanceFull timeWork at office2 days per week- ...conversation for every patient. An AI agent that knows who you are... ...below.About The RoleAs a Research Engineer, you'll be responsible for... ...models and pipelines that optimize for quality, efficiency, and... ...for different tasks based on performance, latency, and costPartner...PerformanceWork at office
- ...Francisco, California. The Role: As a Research Engineer - Brain Computer Interface Models ,... ...for EEG and other BCI modalities Performance optimization of the training stack Integration... ...enjoy what we do and love discussing AI Benefits and Perks:...PerformanceWork at officeRelocation package
- ...Description We are Genmo, a research lab developing the world’s... ...an exceptional Software Engineer to join our research team in... ...frontiers of visual generative AI. As a Research Engineer,... ...GANs, Transformers) Help optimize model performance and scaling capabilities...PerformanceWork at office
- ...become a massive tax of engineering velocity. Resolve AI is solving this by building... ...end-to-end, balancing research and engineering to create... ...ready AI modelsBuild and optimize data pipelines to process... ...evaluate AI models, improve performance, and reduce compute...PerformanceWork at office
$155k - $269k
...Description Waabi, founded by AI visionary Raquel Urtasun, is... ...efficient simulation. As a Research Engineer in the World Models team,... ...and inference pipelines. - Optimize model training and inference... ...incentive awards and an annual performance bonus. Perks/Benefits:...PerformanceFull timeWork at officeWork from homeFlexible hours- ...Francisco, California. The Role: As a Research Engineer - Audio & Speech Models , you will... ...Large-scale audio training runs Performance optimization of our training stack Audio... ...enjoy what we do and love discussing AI Benefits and Perks: Comprehensive...PerformanceWork at officeRelocation package
- ...Job Description The Role: As a Research Engineer - Vision & Vision-Language Models ,... ...methodology ablations and improvements Performance optimization of our training and data processing... ...enjoy what we do and love discussing AI Benefits and Perks:...PerformanceWork at officeRelocation package
- ...Francisco, California. The Role: As a Research Engineer - Language Model Pre-Training , you'... ...runs and model parallelization Performance optimization of our pretraining stack Dataset... ...enjoy what we do and love discussing AI Benefits and Perks:...PerformanceWork at officeRelocation package
- ...the demands of advanced AI. AI for Chips connects... ...work of semiconductor engineering. Our goal is to... ...cycles. This work brings research, model training, and... ...correctness and measurable performance at the center.... ..., and physical design optimization. Develop and test approaches...PerformanceFull time
- ...interpretable, and steerable AI systems. We want AI to be... ...growing group of committed researchers, engineers, policy experts, and business... ...through profiling, optimization, and benchmarking Make the... ...profiling and optimizing the performance of ML workloads Experience...PerformanceWork at officeLocal areaVisa sponsorshipFlexible hours
- ...discovery programs. AI is reinventing life sciences... ...reinvented software engineering, and our team is... ...role Make our models performant, fast, and reliable... ...working closely with researchers on experiments to... ...parallelism, quantization, kernel optimization and whatever else...PerformanceFull time
$200k - $290k
...Shaping team at Together AI works on products and research for tailoring open... .... As a Research Engineer on the Scaling Team within... ...into robust, high-performance systems. You will profile and optimize Together's training... ...optimized NVIDIA GPU kernels using CUDA or Triton,...PerformanceFull time- ...Research Engineer, Code RL (Reinforcement Learning) About Anthropic... ..., and steerable AI systems. We want AI to... ...engineering, to high-performance code for accelerators... ...performance profiling and optimization of ML systems CUDA / GPU or TPU kernel experience and...PerformanceFull timeWork at officeVisa sponsorshipFlexible hours
- ...infrastructure frontier AI labs build... ...secure sandboxes, high-performance training, and... ...tasks like autonomous research, and the full-... ...lengths grow. Optimize multi-node MoE inference... ...of inference-engine internals. Strong... ...CUDA or Triton kernel work, particularly...PerformanceFull timeWork at officeRemote workVisa sponsorshipRelocation packageFlexible hours
- ...infrastructure frontier AI labs build... ...secure sandboxes, high-performance training, and... ...tasks like autonomous research, and the full-... ...Impact Build and optimize the distributed training... ..., including kernels, communication paths... ...infrastructure engineers to translate bottlenecks...PerformanceFull timeWork at officeRemote workVisa sponsorshipRelocation packageFlexible hours
- ...interpretable, and steerable AI systems. We want AI to be... ...growing group of committed researchers, engineers, policy experts, and business... ..., data processing, and optimizer development - Independently... ...Experience - Work on high-performance, large-scale ML systems - Familiarity...PerformanceFull time
- ...We are an applied AI lab building end-to-end software agents... ..., the first AI software engineer. Our team is extremely talent... ...join us. Role Mission Research moves at the speed of the... ...largest RL training scales. Performance Optimization: Profile and improve...PerformanceFull timeLocal area
- ...infrastructure frontier AI labs build internally,... ...sandboxes, high-performance training, and deployment... ...tasks like autonomous research, and the full-stack platform... ...We’re hiring research engineers and scientists across... ...objectives and policy optimization. Investigate...PerformanceFull timeWork at officeRemote workVisa sponsorshipRelocation packageFlexible hours
$150 per hour
...technical talent with leading AI research labs. Headquartered in San... ...machine learning engineering tasks in a long-horizon AI... ...training, fine-tuning, or optimizing models in PyTorch or JAX... ...LLMs , GPU inference and performance , Reinforcement learning...PerformanceContract workSummer workRemote work$200k - $225k
...AlembicAlembic is where top engineers are solving marketing'... ...analyticsDocument research and implementation... ...statistics, probability, optimization, causal... ...with GPU computing and performance optimizationUnderstanding... ...technology: Work with advanced AI/ML algorithms, composite...Performance- ...platform for customer-facing AI agents, working with... ...Labs.Sierra’s Applied Research team advances the... ...learning and long-horizon optimization.Build rigorous... ...evaluations that connect model performance to real-world agent... ...TypeOn-siteDepartmentEngineeringPlatform EngineeringPerformanceFull timeLocal areaFlexible hours
$400k
...Thinking Machines is to build AI that extends human will and... ...for an infrastructure research engineer to design and build the core... ...from precision formats and kernel optimizations to communication frameworks... ...large-scale LLMs, focusing on performance, stability, and...PerformanceFull timeImmediate startVisa sponsorshipWork visaRelocation package- ...interpretable, and steerable AI systems. We want AI... ...group of committed researchers, engineers, policy experts, and... ...Own end-to-end performance of our largest RL runs... ...behavior of large-scale optimization Hands-on... ...before anyone writes the kernel The annual compensation...PerformanceWork at officeLocal areaVisa sponsorshipFlexible hours
- ...We're building a research cohort of senior domain experts in ML inference and GPU kernel engineering — spanning inference serving systems, kernel optimization, and large-model deployment infrastructure — to help evaluate how frontier AI models reason about hard, real-world...Contract work
$58 - $70 per hour
...Role Overview As a Systems Research Engineer Intern specialized in GPU Programming... ...role in developing and optimizing GPU-accelerated kernels and algorithms for ML/AI applications. Working closely... ...model architecture to enhance the performance and efficiency of our AI...PerformanceHourly paySummer workInternship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Engineer - AI Performance & Kernel Optimization. Be the first to apply!
- ai research engineer San Francisco, CA
- deep learning research engineer San Francisco, CA
- research software engineer San Francisco, CA
- research programmer San Francisco, CA
- research engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- research assistant engineering San Francisco, CA
- senior research engineer San Francisco, CA
- senior performance engineer San Francisco, CA
- performance improvement specialist San Francisco, CA






