Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Engineer, Large-Scale Training

$200k - $290k

Together AI

About the Role

The Model Shaping team at Together AI works on products and research for tailoring open foundation models to downstream applications. We build services that allow machine learning developers to choose the best models for their tasks and further improve these models using domain-specific data. In addition, we develop new methods for more efficient model training and evaluation, drawing inspiration from a broad spectrum of ideas across machine learning, natural language processing, and ML systems.

As a Research Engineer on the Scaling Team within Model Shaping, you will turn cutting-edge research on efficient foundation model training into robust, high-performance systems. You will profile and optimize Together's training infrastructure, identify performance bottlenecks across the stack, and implement state-of-the-art techniques from both the research literature and our own scientists in production environments.

Your work will directly shape the fine-tuning experience of Together's customers. You will rapidly bring newly released open-source models onto the Model Shaping platform, ensuring they train efficiently and reliably across diverse customer workloads. Working closely with Research Scientists, you will also build the experimental infrastructure that accelerates research and enables validated ideas to be deployed reliably at scale.

Responsibilities

  • Design, implement, and optimize core components of Together's large-scale training infrastructure.
  • Integrate new model architectures, validate training correctness and convergence, and optimize performance for production fine-tuning workloads.
  • Profile distributed training workloads to identify and eliminate bottlenecks across compute, memory, and communication.
  • Design and execute experiments to validate performance hypotheses and benchmark new approaches against state-of-the-art methods.
  • Partner closely with Research Scientists to productionize novel training methods and contribute to publications and open-source releases.
  • Rapidly enable support for newly released open-source foundation models on the Together platform.
  • Build and maintain experimental infrastructure that accelerates research while ensuring production-quality reliability and scalability.

Requirements

  • Demonstrated ability to independently take ambiguous performance or infrastructure problems from investigation through deployment.
  • Strong programming skills in Python and PyTorch, with an emphasis on writing efficient, maintainable code.
  • Hands-on experience training or fine-tuning large neural networks in multi-GPU or multi-node environments.
  • Solid understanding of ML systems fundamentals, including GPU architecture, mixed-precision training, and distributed training paradigms such as data, tensor, pipeline, or expert parallelism.
  • Strong communication skills and the ability to collaborate effectively with both researchers and engineers.
  • Passion for staying current with advances in AI research and applying them to real-world systems.
  • Excitement about translating cutting-edge research into production systems that deliver customer impact.

Nice to Have

  • Experience writing optimized NVIDIA GPU kernels using CUDA or Triton, or implementing communication collectives with technologies such as NCCL or NVSHMEM.
  • Experience with large-scale training frameworks such as FSDP, DeepSpeed, Megatron-LM, or custom distributed training systems.
  • Experience optimizing distributed training for compute efficiency, memory efficiency, or scalability.
  • Experience running and managing large-scale GPU experiments, including scheduling, monitoring, and fault tolerance.
  • Contributions to widely used open-source ML or ML systems projects.
  • Experience building or operating ML products or managed services used by external customers.

About Together AI

Together AI, the AI Native Cloud, is purpose-built for AI engineers. AI application developers get high-performance inference that scales reliably, fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own. Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month.

Compensation

We offer competitive compensation, startup equity, health insurance, and other benefits. The US base salary range for this full-time position is $200,000 - $290,000. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Application Policy

Please read each role carefully and apply to the position best suited to you. Candidates are limited to 6 applications within a 90-day period, and applications beyond that limit will be automatically rejected. You may apply to additional roles 90 days after your last application.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at 

Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Research Engineer, Large-Scale Training in San Francisco, CA vacancy
  • $350k

     ...quickly growing group of committed researchers, engineers, policy experts, and business leaders...  ...: Anthropic's ML Performance and Scaling team trains our production pretrained models, work...  ...a genuine passion for the craft of large-scale ML systems. This role lives... 
    Training
    Work at office
    Local area
    Visa sponsorship
    Flexible hours
    Weekend work
    Afternoon shift

    Anthropic

    San Francisco, CA
    3 hours ago
  •  ...growing group of committed researchers, engineers, policy experts, and business...  ...systems. About the role: Large teams of agents are starting...  ...studies how these teams scale: what happens to performance...  ...equivalent combination of education, training, and/or experience... 
    Training
    Work at office
    Local area
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    3 hours ago
  •  ...Pantograph is training general models that start by watching internet-scale video and end up on robots. We think the path...  ...robots. We're looking for a research engineer to help us train increasingly...  ...ideas, scaling experiments across large GPU clusters, building the... 
    Training

    Pantograph

    San Francisco, CA
    5 days ago
  •  ...Machine Learning We’re hiring a Founding ML Research Engineer to work work through the full stack across data, pre-training, post-training & evals for training Generalist...  ...but over both text and audio. Build large-scale speech model pre-training and post-training... 
    Training
    Full time

    Kalpa Labs

    San Francisco, CA
    4 days ago
  • $100k - $300k

     ...failing. We believe massive scale through data-driven machine...  ...Position Overview We are hiring Research Engineers to develop scalable robotic...  ...new algorithms for training and optimizing general-purpose...  ...deployable solutions, working with large-scale systems and datasets.... 
    Training

    Skild AI

    San Francisco, CA
    5 days ago
  •  ...deploying real humanoid capabilities. The role As our VLA/WAM Research Engineer, you'll develop the foundation models that power our humanoid robots, spanning model architecture, large-scale pre-training, adaptation, and post-training. You will work across the... 
    Training
    Work at office
    Relocation

    Flexion Robotics

    San Francisco, CA
    14 days ago
  •  ...Research EngineerWe believe that software is the foundation of modern...  ...vulnerabilities. We are training and scaling security AI agents to discover...  ...days vulnerabilities across large customer codebases and...  ...seeking an experienced Research Engineer to join our effort in building... 
    Training
    Full time
    Work at office

    DepthFirst

    San Francisco, CA
    3 days ago
  •  ...San Francisco, California. The Role: As a Research Engineer - Brain Computer Interface Models , you will be...  ...to designing novel architectures and training methodologies. You’ll Work Across: Large-scale EEG model training runs and evaluation Architecture... 
    Training
    Work at office
    Relocation package

    Zyphra

    San Francisco, CA
    5 days ago
  •  ...Description We are Genmo, a research lab developing the...  ...exceptional Software Engineer to join our research...  ...model performance and scaling capabilities Assist...  ...frameworks and model training ~ Understanding of fundamental...  ...architectures Large Language Models... 
    Training
    Work at office

    Genmo

    San Francisco, CA
    22 days ago
  •  ...Research EngineerSesame believes in a future where computers...  ...goals. As a Research engineer at Sesame, you are a...  ...and infra to prototype, train, and deploy state-of-...  ...experience.Squeeze silicon — scale training and inference...  ...or fine-tuning large language or other large... 
    Training
    Full time
    Contract work
    Shift work

    SESAME

    San Francisco, CA
    1 day ago
  •  ...Francisco, California. The Role: As a Research Engineer - Audio & Speech Models , you will be...  ...deeply involved in the entire model training process, from data gathering and...  ...methodologies. You’ll Work Across: Large-scale audio training runs Performance... 
    Training
    Work at office
    Relocation package

    Zyphra

    San Francisco, CA
    24 days ago
  •  ...invented a better way to do research: AI-powered user...  ...unprecedented speed and scale. The research industry...  .... The Research Engineer reports to the Head Scientist...  ...systems built on large language models. Responsibilities...  ...are never used for training. Build and maintain... 
    Training

    Outset

    San Francisco, CA
    3 days ago
  •  ...Job Description The Role: As a Research Engineer - Vision & Vision-Language Models , you...  ...generating data to pretraining, post-training, reinforcement learning, and...  ...training of vision-language models Large-scale vision and multimodal training runs... 
    Training
    Work at office
    Relocation package

    Zyphra

    San Francisco, CA
    3 days ago
  • $155k - $269k

     ...controllable, and efficient simulation. As a Research Engineer in the World Models team, you will...  ...environments. This role focuses on large-scale world models for temporal reasoning...  ...for downstream planning, testing, and training.   You will… - Design, implement, and... 
    Training
    Full time
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    18 days ago
  •  ...become a massive tax of engineering velocity. Resolve AI...  ...end-to-end, balancing research and engineering to create...  ...unstructured data for training and evaluationDesign...  ...-tune and train Large Language Models (LLMs)...  ...Experience working with large-scale data pipelines,... 
    Training
    Work at office

    Resolve AI

    San Francisco, CA
    5 days ago
  •  ...based in San Francisco, California. The Role: As a Research Engineer - Language Model Pre-Training , you'll shape our language model roadmap through...  ...next-generation models. You'll Work Across: Large-scale training runs and model parallelization... 
    Training
    Work at office
    Relocation package

    Zyphra

    San Francisco, CA
    17 days ago
  • $250k - $400k

     ...environments, and frontier research benchmarks that improve model capabilities in software engineering, enterprise knowledge work,...  ...The Role Turing builds large-scale datasets and reinforcement learning...  ...that power post-training for the world's leading AI labs... 
    Training

    Turing

    San Francisco, CA
    23 days ago
  • $350k

     ...Research Engineer / Scientist, AlignmentSan Francisco, CAAbout AnthropicAnthropic...  ...ASL-4 under our Responsible Scaling Policy), often in...  ...of our safety techniques by training language models to subvert our...  ...cohesive team on just a few large-scale research efforts. And... 
    Training
    Work at office
    Visa sponsorship
    Flexible hours

    anthropic

    San Francisco, CA
    1 day ago
  • $200k

     ...About the Role As a Research Engineer at Metis, you’ll work on building the next generation of autonomous post-training systems that leverage our Mantis platform. You’ll operate...  ...between papers and production, leading large-scale experiments, creating optimized... 
    Training

    Metis, Inc.

    San Francisco, CA
    3 days ago
  •  ...re seeking the team of researchers that will build them....  ...looking for a Research Engineer to sit between our...  ...orchestrate and optimize training runs on long-horizon multimodal...  ...data loading over TB-scale multimodal data:...  ...data pipelines over large unstructured and multimodal... 
    Training
    Full time
    Work at office
    Relocation package

    constellation

    San Francisco, CA
    3 days ago
  •  ...company based in San Francisco, California. The Role: As a Research Engineer - AI Performance & Kernel Optimization , you will improve and optimize the performance of our large-scale language model training and inference stacks. You will work closely with our... 
    Training
    Work at office
    Relocation package

    Zyphra

    San Francisco, CA
    a month ago
  •  ...growing group of committed researchers, engineers, policy experts, and business...  ...that builds and owns the RL training system: the system that trains...  ...of making RL work at scale. As a Research Engineer on...  ...debugging, and improving a large ML codebase Experience with... 
    Training
    Work at office
    Local area
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    7 days ago
  •  ...it reinvented software engineering, and our team is...  ...building that future. We train frontier models that...  ...efficient and reliable at scale by developing the core...  ...with fellow researchers and engineers. Build...  ...-end training runs on large GPU clusters; eliminate... 
    Training
    Full time

    Chai Discovery

    San Francisco, CA
    7 days ago
  •  ...growing group of committed researchers, engineers, policy experts, and business...  ...Research Engineer to join our Pre-training team, responsible for developing the next generation of large language models. In this...  ...models - Optimize and scale our training infrastructure... 
    Training
    Full time

    Anthropic

    San Francisco, CA
    13 days ago
  • $260k - $350k

     ...environments, and frontier research benchmarks that improve model capabilities in software engineering, enterprise knowledge work,...  ...The Role Turing builds large-scale datasets and reinforcement learning...  ...that power post-training for the world's leading AI labs... 
    Training

    Turing

    San Francisco, CA
    3 days ago
  •  ...the first AI software engineer. Our team is extremely...  ...edge of AI including Scale AI, Palantir, Cursor, Waymo...  ...us. Role Mission Research moves at the speed of...  ...underneath it. Every training run, evaluation loop, and...  ...the systems that run large-scale training jobs reliably... 
    Training
    Full time
    Local area

    Cognition

    San Francisco, CA
    7 days ago
  •  ...all daily U.S. X-rays. Our research team brings experience from...  ...architectures and training methods that enable AI to understand...  ...resolution visual understanding, and large-scale pretraining across X-rays,...  ...team of researchers and engineers, with the freedom to pursue... 
    Training
    Full time

    epsilon-health

    San Francisco, CA
    3 days ago
  •  ...Specter is hiring a perception AI engineer responsible for turning...  ...vision, vision-language, and large language models to our world-...  ...perception system Building and scaling a production-grade data-...  ...collection, labelling, and model re-training platform Driving the... 
    Training
    Full time

    specter

    San Francisco, CA
    3 days ago
  •  ...Research Scientist, Research Engineer, AI Systems EngineerThe Recursive Self-Improvement (RSI) team works across...  ...loops, designing evaluations, and training models to develop missing...  ...data, research infrastructure, or large-scale distributed systems.Are a strong generalist... 
    Training

    OpenAI

    San Francisco, CA
    5 days ago
  •  ...Google Labs.Sierra’s Applied Research team advances the quality,...  ...tasks. Our work spans post-training open-weight models for specialized...  ...agent quality.Work with large-scale, proprietary datasets spanning...  ...timeLocation TypeOn-siteDepartmentEngineeringPlatform Engineering
    Training
    Full time
    Local area
    Flexible hours

    Sierra

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Engineer, Large-Scale Training. Be the first to apply!