Research Engineer, Large-Scale Training
$200k - $290kTogether AI
About the Role
The Model Shaping team at Together AI works on products and research for tailoring open foundation models to downstream applications. We build services that allow machine learning developers to choose the best models for their tasks and further improve these models using domain-specific data. In addition, we develop new methods for more efficient model training and evaluation, drawing inspiration from a broad spectrum of ideas across machine learning, natural language processing, and ML systems.
As a Research Engineer on the Scaling Team within Model Shaping, you will turn cutting-edge research on efficient foundation model training into robust, high-performance systems. You will profile and optimize Together's training infrastructure, identify performance bottlenecks across the stack, and implement state-of-the-art techniques from both the research literature and our own scientists in production environments.
Your work will directly shape the fine-tuning experience of Together's customers. You will rapidly bring newly released open-source models onto the Model Shaping platform, ensuring they train efficiently and reliably across diverse customer workloads. Working closely with Research Scientists, you will also build the experimental infrastructure that accelerates research and enables validated ideas to be deployed reliably at scale.
Responsibilities
- Design, implement, and optimize core components of Together's large-scale training infrastructure.
- Integrate new model architectures, validate training correctness and convergence, and optimize performance for production fine-tuning workloads.
- Profile distributed training workloads to identify and eliminate bottlenecks across compute, memory, and communication.
- Design and execute experiments to validate performance hypotheses and benchmark new approaches against state-of-the-art methods.
- Partner closely with Research Scientists to productionize novel training methods and contribute to publications and open-source releases.
- Rapidly enable support for newly released open-source foundation models on the Together platform.
- Build and maintain experimental infrastructure that accelerates research while ensuring production-quality reliability and scalability.
Requirements
- Demonstrated ability to independently take ambiguous performance or infrastructure problems from investigation through deployment.
- Strong programming skills in Python and PyTorch, with an emphasis on writing efficient, maintainable code.
- Hands-on experience training or fine-tuning large neural networks in multi-GPU or multi-node environments.
- Solid understanding of ML systems fundamentals, including GPU architecture, mixed-precision training, and distributed training paradigms such as data, tensor, pipeline, or expert parallelism.
- Strong communication skills and the ability to collaborate effectively with both researchers and engineers.
- Passion for staying current with advances in AI research and applying them to real-world systems.
- Excitement about translating cutting-edge research into production systems that deliver customer impact.
Nice to Have
- Experience writing optimized NVIDIA GPU kernels using CUDA or Triton, or implementing communication collectives with technologies such as NCCL or NVSHMEM.
- Experience with large-scale training frameworks such as FSDP, DeepSpeed, Megatron-LM, or custom distributed training systems.
- Experience optimizing distributed training for compute efficiency, memory efficiency, or scalability.
- Experience running and managing large-scale GPU experiments, including scheduling, monitoring, and fault tolerance.
- Contributions to widely used open-source ML or ML systems projects.
- Experience building or operating ML products or managed services used by external customers.
About Together AI
Together AI, the AI Native Cloud, is purpose-built for AI engineers. AI application developers get high-performance inference that scales reliably, fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own. Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month.
Compensation
We offer competitive compensation, startup equity, health insurance, and other benefits. The US base salary range for this full-time position is $200,000 - $290,000. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.
Application Policy
Please read each role carefully and apply to the position best suited to you. Candidates are limited to 6 applications within a 90-day period, and applications beyond that limit will be automatically rejected. You may apply to additional roles 90 days after your last application.
Equal Opportunity
Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Please see our privacy policy at
$350k
...quickly growing group of committed researchers, engineers, policy experts, and business leaders... ...: Anthropic's ML Performance and Scaling team trains our production pretrained models, work... ...a genuine passion for the craft of large-scale ML systems. This role lives...TrainingWork at officeLocal areaVisa sponsorshipFlexible hoursWeekend workAfternoon shift- ...growing group of committed researchers, engineers, policy experts, and business... ...systems. About the role: Large teams of agents are starting... ...studies how these teams scale: what happens to performance... ...equivalent combination of education, training, and/or experience...TrainingWork at officeLocal areaVisa sponsorshipFlexible hours
- ...Pantograph is training general models that start by watching internet-scale video and end up on robots. We think the path... ...robots. We're looking for a research engineer to help us train increasingly... ...ideas, scaling experiments across large GPU clusters, building the...Training
- ...Machine Learning We’re hiring a Founding ML Research Engineer to work work through the full stack across data, pre-training, post-training & evals for training Generalist... ...but over both text and audio. Build large-scale speech model pre-training and post-training...TrainingFull time
$100k - $300k
...failing. We believe massive scale through data-driven machine... ...Position Overview We are hiring Research Engineers to develop scalable robotic... ...new algorithms for training and optimizing general-purpose... ...deployable solutions, working with large-scale systems and datasets....Training- ...deploying real humanoid capabilities. The role As our VLA/WAM Research Engineer, you'll develop the foundation models that power our humanoid robots, spanning model architecture, large-scale pre-training, adaptation, and post-training. You will work across the...TrainingWork at officeRelocation
- ...Research EngineerWe believe that software is the foundation of modern... ...vulnerabilities. We are training and scaling security AI agents to discover... ...days vulnerabilities across large customer codebases and... ...seeking an experienced Research Engineer to join our effort in building...TrainingFull timeWork at office
- ...San Francisco, California. The Role: As a Research Engineer - Brain Computer Interface Models , you will be... ...to designing novel architectures and training methodologies. You’ll Work Across: Large-scale EEG model training runs and evaluation Architecture...TrainingWork at officeRelocation package
- ...Description We are Genmo, a research lab developing the... ...exceptional Software Engineer to join our research... ...model performance and scaling capabilities Assist... ...frameworks and model training ~ Understanding of fundamental... ...architectures Large Language Models...TrainingWork at office
- ...Research EngineerSesame believes in a future where computers... ...goals. As a Research engineer at Sesame, you are a... ...and infra to prototype, train, and deploy state-of-... ...experience.Squeeze silicon — scale training and inference... ...or fine-tuning large language or other large...TrainingFull timeContract workShift work
- ...Francisco, California. The Role: As a Research Engineer - Audio & Speech Models , you will be... ...deeply involved in the entire model training process, from data gathering and... ...methodologies. You’ll Work Across: Large-scale audio training runs Performance...TrainingWork at officeRelocation package
- ...invented a better way to do research: AI-powered user... ...unprecedented speed and scale. The research industry... .... The Research Engineer reports to the Head Scientist... ...systems built on large language models. Responsibilities... ...are never used for training. Build and maintain...Training
- ...Job Description The Role: As a Research Engineer - Vision & Vision-Language Models , you... ...generating data to pretraining, post-training, reinforcement learning, and... ...training of vision-language models Large-scale vision and multimodal training runs...TrainingWork at officeRelocation package
$155k - $269k
...controllable, and efficient simulation. As a Research Engineer in the World Models team, you will... ...environments. This role focuses on large-scale world models for temporal reasoning... ...for downstream planning, testing, and training. You will… - Design, implement, and...TrainingFull timeWork at officeWork from homeFlexible hours- ...become a massive tax of engineering velocity. Resolve AI... ...end-to-end, balancing research and engineering to create... ...unstructured data for training and evaluationDesign... ...-tune and train Large Language Models (LLMs)... ...Experience working with large-scale data pipelines,...TrainingWork at office
- ...based in San Francisco, California. The Role: As a Research Engineer - Language Model Pre-Training , you'll shape our language model roadmap through... ...next-generation models. You'll Work Across: Large-scale training runs and model parallelization...TrainingWork at officeRelocation package
$250k - $400k
...environments, and frontier research benchmarks that improve model capabilities in software engineering, enterprise knowledge work,... ...The Role Turing builds large-scale datasets and reinforcement learning... ...that power post-training for the world's leading AI labs...Training$350k
...Research Engineer / Scientist, AlignmentSan Francisco, CAAbout AnthropicAnthropic... ...ASL-4 under our Responsible Scaling Policy), often in... ...of our safety techniques by training language models to subvert our... ...cohesive team on just a few large-scale research efforts. And...TrainingWork at officeVisa sponsorshipFlexible hours$200k
...About the Role As a Research Engineer at Metis, you’ll work on building the next generation of autonomous post-training systems that leverage our Mantis platform. You’ll operate... ...between papers and production, leading large-scale experiments, creating optimized...Training- ...re seeking the team of researchers that will build them.... ...looking for a Research Engineer to sit between our... ...orchestrate and optimize training runs on long-horizon multimodal... ...data loading over TB-scale multimodal data:... ...data pipelines over large unstructured and multimodal...TrainingFull timeWork at officeRelocation package
- ...company based in San Francisco, California. The Role: As a Research Engineer - AI Performance & Kernel Optimization , you will improve and optimize the performance of our large-scale language model training and inference stacks. You will work closely with our...TrainingWork at officeRelocation package
- ...growing group of committed researchers, engineers, policy experts, and business... ...that builds and owns the RL training system: the system that trains... ...of making RL work at scale. As a Research Engineer on... ...debugging, and improving a large ML codebase Experience with...TrainingWork at officeLocal areaVisa sponsorshipFlexible hours
- ...it reinvented software engineering, and our team is... ...building that future. We train frontier models that... ...efficient and reliable at scale by developing the core... ...with fellow researchers and engineers. Build... ...-end training runs on large GPU clusters; eliminate...TrainingFull time
- ...growing group of committed researchers, engineers, policy experts, and business... ...Research Engineer to join our Pre-training team, responsible for developing the next generation of large language models. In this... ...models - Optimize and scale our training infrastructure...TrainingFull time
$260k - $350k
...environments, and frontier research benchmarks that improve model capabilities in software engineering, enterprise knowledge work,... ...The Role Turing builds large-scale datasets and reinforcement learning... ...that power post-training for the world's leading AI labs...Training- ...the first AI software engineer. Our team is extremely... ...edge of AI including Scale AI, Palantir, Cursor, Waymo... ...us. Role Mission Research moves at the speed of... ...underneath it. Every training run, evaluation loop, and... ...the systems that run large-scale training jobs reliably...TrainingFull timeLocal area
- ...all daily U.S. X-rays. Our research team brings experience from... ...architectures and training methods that enable AI to understand... ...resolution visual understanding, and large-scale pretraining across X-rays,... ...team of researchers and engineers, with the freedom to pursue...TrainingFull time
- ...Specter is hiring a perception AI engineer responsible for turning... ...vision, vision-language, and large language models to our world-... ...perception system Building and scaling a production-grade data-... ...collection, labelling, and model re-training platform Driving the...TrainingFull time
- ...Research Scientist, Research Engineer, AI Systems EngineerThe Recursive Self-Improvement (RSI) team works across... ...loops, designing evaluations, and training models to develop missing... ...data, research infrastructure, or large-scale distributed systems.Are a strong generalist...Training
- ...Google Labs.Sierra’s Applied Research team advances the quality,... ...tasks. Our work spans post-training open-weight models for specialized... ...agent quality.Work with large-scale, proprietary datasets spanning... ...timeLocation TypeOn-siteDepartmentEngineeringPlatform EngineeringTrainingFull timeLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Engineer, Large-Scale Training. Be the first to apply!
- ai research engineer San Francisco, CA
- deep learning research engineer San Francisco, CA
- research software engineer San Francisco, CA
- research programmer San Francisco, CA
- research engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- research assistant engineering San Francisco, CA
- senior research engineer San Francisco, CA
- brain research San Francisco, CA
- physics research San Francisco, CA




