Research Engineer, Infrastructure, Kernels
$400kthinkingmachines
About Thinking Machines
The mission of Thinking Machines is to build AI that extends human will and judgment. We are training frontier models with Inkling, developing Tinker to let people make models their own, and crafting interfaces that broaden human-AI communication. We believe the future worth building is human, and we're hiring people who want to build it.
About the Role
We’re looking for an infrastructure research engineer to design, optimize, and maintain the compute foundations that power large-scale language model training. You will develop high-performance ML kernels (e.g., CUDA, CuTe, Triton), enable efficient low-precision arithmetic, and improve the distributed compute stack that makes training large models possible.
This role is perfect for an engineer who enjoys working close to the metal and across the research boundary. You’ll collaborate with researchers and systems architects to bridge algorithmic design with hardware efficiency. You’ll prototype new kernel implementations, profile performance across hardware generations, and help define the numerical and parallelism strategies that determine how we scale next-generation AI systems.
Note: This is an "evergreen role" that we keep open on an on-going basis to express interest. We receive many applications, and there may not always be an immediate role that aligns perfectly with your experience and skills. Still, we encourage you to apply. We continuously review applications and reach out to applicants as new opportunities open. You are welcome to reapply if you get more experience, but please avoid applying more than once every 6 months. You may also find that we put up postings for singular roles for separate, project or team specific needs. In those cases, you're welcome to apply directly in addition to an evergreen role.
What You’ll Do
Design and implement custom ML kernels (e.g., CUDA, CuTe, Triton) for core LLM operations such as attention, matrix multiplication, gating, and normalization, optimized for modern GPU and accelerator architectures.
Design and think through compute primitives to reduce memory bandwidth bottlenecks and improve kernel compute efficiency.
Collaborate with research teams to align kernel-level optimizations with model architecture and algorithmic goals.
Develop and maintain a library of reusable kernels and performance benchmarks that serve as the foundation for internal model training.
Contribute to infrastructure stability and scalability, ensuring reproducibility, consistency across precision formats, and high utilization of compute resources.
Document and share insights through internal talks, technical papers, or open-source contributions to strengthen the broader ML systems community.
Skills and Qualifications
Minimum qualifications:
Bachelor’s degree or equivalent experience in computer science, electrical engineering, statistics, machine learning, physics, robotics, or similar.
Strong engineering skills, ability to contribute performant, maintainable code and debug in complex codebases
Understanding of deep learning frameworks (e.g., PyTorch, JAX) and their underlying system architectures.
Thrive in a highly collaborative environment involving many, different cross-functional partners and subject matter experts.
A bias for action with a mindset to take initiative to work across different stacks and different teams where you spot the opportunity to make sure something ships.
Proficiency in CUDA, CuTe, Triton, or other GPU programming frameworks.
Demonstrated ability to analyze, profile, and optimize compute-intensive workloads.
Preferred qualifications — we encourage you to apply if you meet some but not all of these:
Experience training or supporting large-scale language models with tens of billions of parameters or more.
Track record of improving research productivity through infrastructure design or process improvements.
Experience developing or tuning kernels for deep learning frameworks such as PyTorch, JAX, or custom accelerators.
Familiarity with tensor parallelism, pipeline parallelism, or distributed data processing frameworks.
Experience implementing low-precision formats (FP8, INT8, block floating point) or contributing to related compiler stacks (e.g., XLA, TVM).
Contributions to open-source GPU, ML systems, or compiler optimization projects.
Prior research or engineering experience in numerical optimization, communication-efficient training, or scalable AI infrastructure.
Logistics
Location: This role is based in San Francisco, California.
Compensation: Depending on background, skills and experience, the expected annual salary range for this position is $400,000 - $500,000 USD.
Visa sponsorship: We sponsor visas. While we can't guarantee success for every candidate or role, if you're the right fit, we're committed to working through the visa process together.
Benefits: Thinking Machines offers generous health, dental, and vision benefits, unlimited PTO, paid parental leave, and relocation support as needed.
- ...sciences the same way it reinvented software engineering, and our team is building that future.... ...evaluation, in close partnerships with fellow researchers and engineers. Build our training stack across model, layer, and kernel levels; optimize workloads through...SuggestedFull time
- ...based in San Francisco, California. The Role: As a Research Engineer - AI Performance & Kernel Optimization , you will improve and optimize the... ...300x and MI355x Collaboration with research and infrastructure teams to turn systems improvements into real-world model...SuggestedWork at officeRelocation package
$400k
...lasting days or weeks. We’re looking for engineers to build and improve those systems, working closely with researchers on the infrastructure behind large-scale pre-training and mid-... ...profiling, mixed precision, FP4/FP8, kernels or compiler work. Developing NCCL or...SuggestedFull timeImmediate startVisa sponsorshipWork visaRelocation package- .... We're the makers of Devin, the first AI software engineer. Our team is extremely talent-dense. Among our founding... ...-world tasks, apply to join us. Role Mission Research moves at the speed of the infrastructure underneath it. Every training run, evaluation loop,...SuggestedFull timeLocal area
$400k
...to build it. About the Role We’re looking for an infrastructure research engineer to design and build the core systems that enable efficient... ...distributed training stack, from precision formats and kernel optimizations to communication frameworks that make training...SuggestedFull timeImmediate startVisa sponsorshipWork visaRelocation package- ...superintelligence stack: the infrastructure frontier AI labs build... ...horizon tasks like autonomous research, and the full-stack platform... ...performance optimizations, including kernels, communication paths, and... ...and infrastructure engineers to translate bottlenecks into...Full timeWork at officeRemote workVisa sponsorshipRelocation packageFlexible hours
- ...We're building a research cohort of senior domain experts in ML inference and GPU kernel engineering — spanning inference serving systems, kernel optimization, and large-model deployment infrastructure — to help evaluate how frontier AI models reason about hard, real-...Contract work
- ...durable robots. We're looking for a research engineer to help us train increasingly capable... ...data processing, evaluation, and the infrastructure required to support all of it. You... ...with JAX Experience writing CUDA kernels or otherwise optimizing GPU workloads...
- ...subsidiaries.Kovari is a small team of builders, operators, and researchers. They deploy on-site alongside the businesses they serve and... ...optimization using TensorRT, ONNX Runtime, or TVMExperience with CUDA kernel optimizationA bias toward action: train fast, deploy early,...
$175k - $260k
...About HUD About the role Were looking for a Senior Research Infrastructure Engineer to accelerate research on training and evaluating frontier AI agents. Youll build the software and infrastructure that enable HUDs researchers to iterate on environments collect...Full timeWork at officeRemote workRelocationVisa sponsorship- ...Research Engineer Training and Environment Infrastructure San Francisco CA Hybrid Full-Time Permanent Employment Mid-Level ASAP Start MaxIT Consulting Max Corporate Group is looking for a Research Engineer to build the training and environment infrastructure of a...Permanent employmentFull timeH1bWork at officeImmediate startVisa sponsorshipFlexible hours3 days per week
$230k
...team to scale up our post-training efforts. You’ll own the infrastructure behind that effort: distributed training, RL rollout... ...together. You’ll join a small, high-bar team of hands-on engineers and researchers, where each person owns a large part of the stack. We’...Remote jobFull time$400k
...worth building is human, and we're hiring people who want to build it. About the Role We’re looking for an infrastructure research engineer to design, optimize, and scale the systems that power large AI models. Your work will make inference faster, more cost...Full timeImmediate startVisa sponsorshipWork visaRelocation package$200k - $275k
...positive way. To learn more visit: As a Research Engineer focused on Generative AI Deployment,... ...to end, from the model graph to GPU kernels and memory movement. Apply techniques... ..., or cut its sampling steps. Cloud Infrastructure. You have experience launching and...Full timeWork at officeWork from homeFlexible hours- ...and we're seeking the team of researchers that will build them.... ...We're looking for a Research Engineer to sit between our data and... ...profiling to find which of kernel, dataloader, communication or... ...building ML systems or research infrastructure, including distributed training...Full timeWork at officeRelocation package
- ...layer of the stack: data, pre-training, post-training, kernels, and infrastructure. We’ve raised over $30M from top-tier investors,... ...dispatch. About the Team We’re a small team of researchers and engineers from MIT, Stanford, CMU, MosaicML, Citadel, and Genesis...Full timeWork at office
$148k - $240k
...Intelligence team builds ML and physics-based infrastructure for drug discovery: biophysics... ...data. Production-grade tooling from research prototypes — taking scientific workflows... ...to scalable, maintainable services. Engineering conventions (CI, testing, packaging, release...Full timeWork at officeLocal areaFlexible hours- ...combines deep expertise in model innovation and systems engineering paired with a design-minded product engineering team... ...the lifeblood of our models, and we are looking for a Research Engineer, Data Infrastructure to build the datasets and systems that power...Full timeWork at officeVisa sponsorshipFlexible hours
$180k - $290k
...platforms. We're a small, fast growing research lab competing with the largest companies... ...longer cleanly separated into “research” or “engineering.” A promising architecture only matters... ...arise: attention performance, custom kernels, low-precision training, profiling, memory...Full timeWork at office2 days per week- ...maintenance and production troubleshooting have become a massive tax of engineering velocity. Resolve AI is solving this by building a... ...What You'll DoDevelop AI-powered workflows end-to-end, balancing research and engineering to create production-ready AI modelsBuild and...Work at office
- ...review workflow, and then work with a team to integrate successful prototypes into production systems Stay on top of the latest research across LLMs, information retrieval, and developer tooling Qualifications B.S. in Computer Science or equivalent Research...Work at office
$9.7k - $19k
...Research Engineer InternThe Center for AI Safety (CAIS) is a leading research and advocacy organization focused on mitigating societal-scale risks from AI. Some of our past achievements include: releasing the most widely used measure of AI capabilities used by all major...Full timeInternshipLocal area- ...Research EngineerLotus Health is a groundbreaking primary care app that integrates your medical records, AI, and real doctors to provide... ...healthcare and prescriptions.We are hiring a Founding Research Engineer to design, prototype, and ship the core reasoning and agentic...
$122k - $215k
...diverse, innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit: As a Research Engineer, you will be at the forefront of advancing and deploying artificial intelligence algorithms for our self-driving vehicles. You...Full timeWork at officeWork from homeFlexible hours- ...Description Job Description We are Genmo, a research lab developing the world’s most... ...We're seeking an exceptional Software Engineer to join our research team in advancing... ...workshop papers Experience with ML infrastructure and deployment This position is onsite...Work at office
- ...frontier AI. The Impact You'll Make Our research team is expanding to keep pace with a... ...edge of the field. As a Research Engineer, you'll take a research direction and run... ...– eval harnesses, environments, infrastructure – without relying on a platform team....Full time
- ...San Francisco, CA, US Full-time Will sponsor 3+ years Machine Learning We’re hiring a Founding ML Research Engineer to work work through the full stack across data, pre-training, post-training & evals for training Generalist Audio Models. You’ll work through the entire...Full time
- ...Research EngineerSesame believes in a future where computers are lifelike - with the ability to see, hear, and collaborate with us in... ...are needed to realize all of our product goals. As a Research engineer at Sesame, you are a research-oriented person with experience in...Full timeContract workShift work
- ...Outset invented a better way to do research: AI-powered user interviews. Global brands... ...levels of analysis. The Research Engineer reports to the Head Scientist and builds... ...Responsibilities Own the evaluation infrastructure that tests competing modeling...
$155k - $269k
...realistic, scalable, controllable, and efficient simulation. As a Research Engineer in the World Models team, you will develop algorithms and... ..., and maintainability of the world model codebase and infrastructure. - Stay on top of emerging advances in generative AI, distributed...Full timeWork at officeWork from homeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Engineer, Infrastructure, Kernels. Be the first to apply!
- ai research engineer San Francisco, CA
- deep learning research engineer San Francisco, CA
- research software engineer San Francisco, CA
- research programmer San Francisco, CA
- research engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- research assistant engineering San Francisco, CA
- senior research engineer San Francisco, CA
- remote infrastructure engineer San Francisco, CA
- lead infrastructure engineer San Francisco, CA




