Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Engineer, Infrastructure, Kernels

$400k
Full-time

thinkingmachines

About Thinking Machines

The mission of Thinking Machines is to build AI that extends human will and judgment. We are training frontier models with Inkling, developing Tinker to let people make models their own, and crafting interfaces that broaden human-AI communication. We believe the future worth building is human, and we're hiring people who want to build it.

About the Role

We’re looking for an infrastructure research engineer to design, optimize, and maintain the compute foundations that power large-scale language model training. You will develop high-performance ML kernels (e.g., CUDA, CuTe, Triton), enable efficient low-precision arithmetic, and improve the distributed compute stack that makes training large models possible.

This role is perfect for an engineer who enjoys working close to the metal and across the research boundary. You’ll collaborate with researchers and systems architects to bridge algorithmic design with hardware efficiency. You’ll prototype new kernel implementations, profile performance across hardware generations, and help define the numerical and parallelism strategies that determine how we scale next-generation AI systems.

Note: This is an "evergreen role" that we keep open on an on-going basis to express interest. We receive many applications, and there may not always be an immediate role that aligns perfectly with your experience and skills. Still, we encourage you to apply. We continuously review applications and reach out to applicants as new opportunities open. You are welcome to reapply if you get more experience, but please avoid applying more than once every 6 months. You may also find that we put up postings for singular roles for separate, project or team specific needs. In those cases, you're welcome to apply directly in addition to an evergreen role.

What You’ll Do

  • Design and implement custom ML kernels (e.g., CUDA, CuTe, Triton) for core LLM operations such as attention, matrix multiplication, gating, and normalization, optimized for modern GPU and accelerator architectures.

  • Design and think through compute primitives to reduce memory bandwidth bottlenecks and improve kernel compute efficiency.

  • Collaborate with research teams to align kernel-level optimizations with model architecture and algorithmic goals.

  • Develop and maintain a library of reusable kernels and performance benchmarks that serve as the foundation for internal model training.

  • Contribute to infrastructure stability and scalability, ensuring reproducibility, consistency across precision formats, and high utilization of compute resources.

  • Document and share insights through internal talks, technical papers, or open-source contributions to strengthen the broader ML systems community.

Skills and Qualifications

Minimum qualifications:

  • Bachelor’s degree or equivalent experience in computer science, electrical engineering, statistics, machine learning, physics, robotics, or similar.

  • Strong engineering skills, ability to contribute performant, maintainable code and debug in complex codebases

  • Understanding of deep learning frameworks (e.g., PyTorch, JAX) and their underlying system architectures.

  • Thrive in a highly collaborative environment involving many, different cross-functional partners and subject matter experts.

  • A bias for action with a mindset to take initiative to work across different stacks and different teams where you spot the opportunity to make sure something ships.

  • Proficiency in CUDA, CuTe, Triton, or other GPU programming frameworks.

  • Demonstrated ability to analyze, profile, and optimize compute-intensive workloads.

Preferred qualifications — we encourage you to apply if you meet some but not all of these:

  • Experience training or supporting large-scale language models with tens of billions of parameters or more.

  • Track record of improving research productivity through infrastructure design or process improvements.

  • Experience developing or tuning kernels for deep learning frameworks such as PyTorch, JAX, or custom accelerators.

  • Familiarity with tensor parallelism, pipeline parallelism, or distributed data processing frameworks.

  • Experience implementing low-precision formats (FP8, INT8, block floating point) or contributing to related compiler stacks (e.g., XLA, TVM).

  • Contributions to open-source GPU, ML systems, or compiler optimization projects.

  • Prior research or engineering experience in numerical optimization, communication-efficient training, or scalable AI infrastructure.

Logistics

  • Location: This role is based in San Francisco, California. 

  • Compensation: Depending on background, skills and experience, the expected annual salary range for this position is $400,000 - $500,000 USD.

  • Visa sponsorship: We sponsor visas. While we can't guarantee success for every candidate or role, if you're the right fit, we're committed to working through the visa process together.

  • Benefits: Thinking Machines offers generous health, dental, and vision benefits, unlimited PTO, paid parental leave, and relocation support as needed.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Research Engineer, Infrastructure, Kernels in San Francisco, CA vacancy
  •  ...sciences the same way it reinvented software engineering, and our team is building that future....  ...evaluation, in close partnerships with fellow researchers and engineers. Build our training stack across model, layer, and kernel levels; optimize workloads through... 
    Suggested
    Full time

    Chai Discovery

    San Francisco, CA
    7 days ago
  •  ...based in San Francisco, California. The Role: As a Research Engineer - AI Performance & Kernel Optimization , you will improve and optimize the...  ...300x and MI355x Collaboration with research and infrastructure teams to turn systems improvements into real-world model... 
    Suggested
    Work at office
    Relocation package

    Zyphra

    San Francisco, CA
    a month ago
  • $400k

     ...lasting days or weeks. We’re looking for engineers to build and improve those systems, working closely with researchers on the infrastructure behind large-scale pre-training and mid-...  ...profiling, mixed precision, FP4/FP8, kernels or compiler work. Developing NCCL or... 
    Suggested
    Full time
    Immediate start
    Visa sponsorship
    Work visa
    Relocation package

    Thinking Machines Lab

    San Francisco, CA
    7 days ago
  •  .... We're the makers of Devin, the first AI software engineer. Our team is extremely talent-dense. Among our founding...  ...-world tasks, apply to join us. Role Mission Research moves at the speed of the infrastructure underneath it. Every training run, evaluation loop,... 
    Suggested
    Full time
    Local area

    Cognition

    San Francisco, CA
    7 days ago
  • $400k

     ...to build it. About the Role We’re looking for an infrastructure research engineer to design and build the core systems that enable efficient...  ...distributed training stack, from precision formats and kernel optimizations to communication frameworks that make training... 
    Suggested
    Full time
    Immediate start
    Visa sponsorship
    Work visa
    Relocation package

    thinkingmachines

    San Francisco, CA
    3 days ago
  •  ...superintelligence stack: the infrastructure frontier AI labs build...  ...horizon tasks like autonomous research, and the full-stack platform...  ...performance optimizations, including kernels, communication paths, and...  ...and infrastructure engineers to translate bottlenecks into... 
    Full time
    Work at office
    Remote work
    Visa sponsorship
    Relocation package
    Flexible hours

    PrimeIntellect

    San Francisco, CA
    3 days ago
  •  ...We're building a research cohort of senior domain experts in ML inference and GPU kernel engineering — spanning inference serving systems, kernel optimization, and large-model deployment infrastructure — to help evaluate how frontier AI models reason about hard, real-... 
    Contract work

    AfterQuery

    San Francisco, CA
    a month ago
  •  ...durable robots. We're looking for a research engineer to help us train increasingly capable...  ...data processing, evaluation, and the infrastructure required to support all of it. You...  ...with JAX Experience writing CUDA kernels or otherwise optimizing GPU workloads... 

    Pantograph

    San Francisco, CA
    5 days ago
  •  ...subsidiaries.Kovari is a small team of builders, operators, and researchers. They deploy on-site alongside the businesses they serve and...  ...optimization using TensorRT, ONNX Runtime, or TVMExperience with CUDA kernel optimizationA bias toward action: train fast, deploy early,... 

    Rethink recruit

    San Francisco, CA
    4 days ago
  • $175k - $260k

     ...About HUD About the role Were looking for a Senior Research Infrastructure Engineer to accelerate research on training and evaluating frontier AI agents. Youll build the software and infrastructure that enable HUDs researchers to iterate on environments collect... 
    Full time
    Work at office
    Remote work
    Relocation
    Visa sponsorship

    HUD

    San Francisco, CA
    5 days ago
  •  ...Research Engineer Training and Environment Infrastructure San Francisco CA Hybrid Full-Time Permanent Employment Mid-Level ASAP Start MaxIT Consulting Max Corporate Group is looking for a Research Engineer to build the training and environment infrastructure of a... 
    Permanent employment
    Full time
    H1b
    Work at office
    Immediate start
    Visa sponsorship
    Flexible hours
    3 days per week

    MaxIT Consulting - Max Corporate Group

    San Francisco, CA
    11 days ago
  • $230k

     ...team to scale up our post-training efforts. You’ll own the infrastructure behind that effort: distributed training, RL rollout...  ...together. You’ll join a small, high-bar team of hands-on engineers and researchers, where each person owns a large part of the stack. We’... 
    Remote job
    Full time

    harvey

    San Francisco, CA
    2 days ago
  • $400k

     ...worth building is human, and we're hiring people who want to build it. About the Role We’re looking for an infrastructure research engineer to design, optimize, and scale the systems that power large AI models. Your work will make inference faster, more cost... 
    Full time
    Immediate start
    Visa sponsorship
    Work visa
    Relocation package

    thinkingmachines

    San Francisco, CA
    3 days ago
  • $200k - $275k

     ...positive way. To learn more visit: As a Research Engineer focused on Generative AI Deployment,...  ...to end, from the model graph to GPU kernels and memory movement. Apply techniques...  ..., or cut its sampling steps. Cloud Infrastructure. You have experience launching and... 
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    4 days ago
  •  ...and we're seeking the team of researchers that will build them....  ...We're looking for a Research Engineer to sit between our data and...  ...profiling to find which of kernel, dataloader, communication or...  ...building ML systems or research infrastructure, including distributed training... 
    Full time
    Work at office
    Relocation package

    constellation

    San Francisco, CA
    3 days ago
  •  ...layer of the stack: data, pre-training, post-training, kernels, and infrastructure. We’ve raised over $30M from top-tier investors,...  ...dispatch. About the Team We’re a small team of researchers and engineers from MIT, Stanford, CMU, MosaicML, Citadel, and Genesis... 
    Full time
    Work at office

    phonic

    San Francisco, CA
    3 days ago
  • $148k - $240k

     ...Intelligence team builds ML and physics-based infrastructure for drug discovery: biophysics...  ...data. Production-grade tooling from research prototypes — taking scientific workflows...  ...to scalable, maintainable services. Engineering conventions (CI, testing, packaging, release... 
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    San Francisco, CA
    3 hours ago
  •  ...combines deep expertise in model innovation and systems engineering paired with a design-minded product engineering team...  ...the lifeblood of our models, and we are looking for a Research Engineer, Data Infrastructure to build the datasets and systems that power... 
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    cartesia

    San Francisco, CA
    3 days ago
  • $180k - $290k

     ...platforms. We're a small, fast growing research lab competing with the largest companies...  ...longer cleanly separated into “research” or “engineering.” A promising architecture only matters...  ...arise: attention performance, custom kernels, low-precision training, profiling, memory... 
    Full time
    Work at office
    2 days per week

    Black Forest Labs

    San Francisco, CA
    7 days ago
  •  ...maintenance and production troubleshooting have become a massive tax of engineering velocity. Resolve AI is solving this by building a...  ...What You'll DoDevelop AI-powered workflows end-to-end, balancing research and engineering to create production-ready AI modelsBuild and... 
    Work at office

    Resolve AI

    San Francisco, CA
    5 days ago
  •  ...review workflow, and then work with a team to integrate successful prototypes into production systems Stay on top of the latest research across LLMs, information retrieval, and developer tooling Qualifications B.S. in Computer Science or equivalent Research... 
    Work at office

    Greptile

    San Francisco, CA
    2 days ago
  • $9.7k - $19k

     ...Research Engineer InternThe Center for AI Safety (CAIS) is a leading research and advocacy organization focused on mitigating societal-scale risks from AI. Some of our past achievements include: releasing the most widely used measure of AI capabilities used by all major... 
    Full time
    Internship
    Local area

    Center for AI Safety

    San Francisco, CA
    1 day ago
  •  ...Research EngineerLotus Health is a groundbreaking primary care app that integrates your medical records, AI, and real doctors to provide...  ...healthcare and prescriptions.We are hiring a Founding Research Engineer to design, prototype, and ship the core reasoning and agentic... 

    Lotus Health

    San Francisco, CA
    1 day ago
  • $122k - $215k

     ...diverse, innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit: As a Research Engineer, you will be at the forefront of advancing and deploying artificial intelligence algorithms for our self-driving vehicles. You... 
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    4 days ago
  •  ...Description Job Description We are Genmo, a research lab developing the world’s most...  ...We're seeking an exceptional Software Engineer to join our research team in advancing...  ...workshop papers Experience with ML infrastructure and deployment This position is onsite... 
    Work at office

    Genmo

    San Francisco, CA
    22 days ago
  •  ...frontier AI. The Impact You'll Make Our research team is expanding to keep pace with a...  ...edge of the field. As a Research Engineer, you'll take a research direction and run...  ...– eval harnesses, environments, infrastructure – without relying on a platform team.... 
    Full time

    SuperAnnotate AI

    San Francisco, CA
    26 days ago
  •  ...San Francisco, CA, US Full-time Will sponsor 3+ years Machine Learning We’re hiring a Founding ML Research Engineer to work work through the full stack across data, pre-training, post-training & evals for training Generalist Audio Models. You’ll work through the entire... 
    Full time

    Kalpa Labs

    San Francisco, CA
    4 days ago
  •  ...Research EngineerSesame believes in a future where computers are lifelike - with the ability to see, hear, and collaborate with us in...  ...are needed to realize all of our product goals. As a Research engineer at Sesame, you are a research-oriented person with experience in... 
    Full time
    Contract work
    Shift work

    SESAME

    San Francisco, CA
    1 day ago
  •  ...Outset invented a better way to do research: AI-powered user interviews. Global brands...  ...levels of analysis. The Research Engineer reports to the Head Scientist and builds...  ...Responsibilities Own the evaluation infrastructure that tests competing modeling... 

    Outset

    San Francisco, CA
    3 days ago
  • $155k - $269k

     ...realistic, scalable, controllable, and efficient simulation. As a Research Engineer in the World Models team, you will develop algorithms and...  ..., and maintainability of the world model codebase and infrastructure. - Stay on top of emerging advances in generative AI, distributed... 
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    18 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Engineer, Infrastructure, Kernels. Be the first to apply!