Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Scientist - Multimodal Interaction and World Model - Pre-Training Technology - Compute[...]

$187.04k

ByteDance

Research Scientist - Multimodal Interaction and World Model - Pre-Training Location: San Jose Responsibilities About Seed Team: Established in 2023, the ByteDance Seed team is dedicated to discovering new approaches to general intelligence, and pursuing the edge of intelligence. Our research spans large language models, GenMedia, AI for Science, Robotics and more. With a long-term vision and determination in AI, the ByteDance Seed team remains committed to foundational research. We aim to become a world‑class AI research team that drives real technological progress and delivers societal benefits. With labs across China, Singapore, and the U.S., our team has already released industry‑leading general‑purpose large models and advanced multimodal capabilities, powering over 50 real‑world applications — including Doubao, Coze, and Jimeng. Drive research and engineering to advance models that enhance understanding of multimodal data and enlarge reasoning capabilities. Design novel architectures that optimize both the model's performance and efficiency. Establish scaling laws, design and conduct systematic ablations that result in transferrable conclusions. Qualifications Expertise in Transformers (Dense and MoE) and familiar with how to scale Transformers on GPUs or TPUs. Rich hands‑on experience in PyTorch/JAX and distributed training framework. Familiar with state‑of‑the‑art techniques for preparing multimodal training data. Job Information The base salary range for this position in the selected city is $187,040 — $438,000 annually. Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units. Benefits Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short‑term and long‑term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure). Legal and Equity The Company reserves the right to modify or change these benefits programs at any time, with or without notice. Consideration for Los Angeles County (unincorporated) Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

  1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;
  2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems;
  3. Exercising sound judgment.
About Us Founded in 2012, ByteDance’s mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join ByteDance Inspiring creativity is at the core of ByteDance’s mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life – a mission we work towards every day. As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us. Diversity & Inclusion ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too. Reasonable Accommodation ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at #J-18808-Ljbffr ByteDance

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Research Scientist - Multimodal Interaction and World Model - Pre-Training Technology - Compute[...] in San Jose, CA vacancy
  • $212.8k - $387.6k

    Team Overview The Seed Multimodal Interaction and World Model team is dedicated to developing...  ...and interaction. Build training pipelines including data...  ...'s or Master's degree in computer science, mathematics,...  ...and access to information technology systems. Exercising sound... 
    Training
    Temporary work
    Internship
    Local area

    ByteDance

    San Jose, CA
    1 day ago
  • $244.8k

     ...intelligence, with research spanning MLLM, GenMedia...  ...general foundation models and multimodal capabilities,...  ...Software Development, Computer Science, Computer Engineering...  ...JAX and distributed training frameworks Familiar...  ...of employment: Interacting with internal/external... 
    Training

    ByteDance

    San Jose, CA
    1 day ago
  • $162k - $316.8k

    World Model Research Scientist (Intelligent Creation) - Global...  ...AI and multimodal models (e.g., image...  ..., through post-training techniques. Design...  ...Development, Computer Science, Computer...  ...employment: Interacting and occasionally...  ...to information technology systems; Exercising... 
    Training
    Temporary work
    Local area

    TikTok

    San Jose, CA
    1 day ago
  • $212.8k

    Senior Research Scientist (Multimodal Large Language Model) - PICO Location: San Jose Team: Technology Employment Type: Regular...  ...intelligent human-computer interaction in MR environments...  ..., and end-to-end training/inference acceleration...  ...large model pre-training, post-training... 
    Training
    Temporary work
    Local area

    ByteDance

    San Jose, CA
    3 days ago
  • $187.04k

    A leading tech company is seeking a Research Scientist for Multimodal Interaction and World Model. This role focuses on enhancing models for multimodal data understanding, requiring expertise in AI and hands-on experience with frameworks like PyTorch/JAX. The position offers... 
    Training

    ByteDance

    San Jose, CA
    2 days ago
  • $60 per hour

     ...machine learning models and systems...  ...learning technologies and scale...  ...everyone in the world. Project...  ...multilingual and multimodal content, and...  ...training and routing...  ...and produce research outcomes with...  ...pursuing a PhD in Computer Science, Data...  ...employment: Interacting and occasionally... 
    Training
    Hourly pay
    Summer work
    Internship
    Local area
    Flexible hours
    Shift work

    TikTok

    San Jose, CA
    1 day ago
  • $190k - $250k

     ...(AI) powered technology stack purpose-...  ...perceive the world, it learns how...  ...generative world models that learn to...  ...scalable closed-loop training, validation,...  ...looking for a research scientist to lead the...  ...for joint multimodal generation that...  ...bring:PhD in Computer Science, AI, Robotics... 
    Training
    Temporary work
    Work at office
    Visa sponsorship

    Kodiak Robotics

    Mountain View, CA
    15 hours ago
  • $165k - $185k

     ...DescriptionThe Bosch Research and Technology Center North...  ...on Foundation Models, Big Data Visual...  ...Language Processing, Computer Vision & Mixed...  ...analysis, and interactive visualization technologies...  ...around the world. Their...  ...models, including training, fine-tuning, and... 
    Training
    Work experience placement
    Worldwide

    Robert Bosch

    Sunnyvale, CA
    15 hours ago
  • $187.04k - $359.72k

    Senior Research Scientist, Foundation Model (LLM/ VLLM), TikTok...  ...learning technologies and scale them...  ...in the world. We are looking...  ...the design, training, and deployment...  ...centralized compute and scalable...  ..., multimodal, and low-resource...  ...employment: 1. Interacting and... 
    Training
    Full time
    Temporary work
    Local area

    TikTok

    San Jose, CA
    1 day ago
  • $174.72k - $295.68k

     ...leading smart technology company at...  ...generative modeling and large-scale...  ..., you will research, implement,...  ...and evaluate world models that...  ...large-scale multimodal data — predicting...  ...for training and evaluating...  ...experts in computer vision, generative...  ...predictive pre-training to... 
    Training
    Full time

    XPENG Motors

    Santa Clara, CA
    2 days ago
  • $45 per hour

    Responsibilities Support research and development of foundation models and systems....  ...'s degree in computer science, mathematics...  ...conferences related to multimodal learning, machine...  ...of employment: Interacting and occasionally...  ...access to information technology systems; and... 
    Hourly pay
    Internship
    Local area

    ByteDance

    San Jose, CA
    2 days ago
  • Responsibilities Conduct research on multimodal foundation models and related systems. Explore methods to improve...  ...such as vision-language modeling, world modeling, and representation...  ...Qualifications Currently pursuing a PhD in computer science, mathematics, engineering,... 

    ByteDance

    San Jose, CA
    5 hours ago
  • $244.8k

     ...foundational models for visual...  ...developing multimodal generative models...  ...out leading research and...  ...fundamental computer vision challenges...  ...pipelines, pre-training strategies,...  ...Explore real‑world applications...  ...employment: Interacting and occasionally...  ...information technology systems.... 
    Training
    Temporary work
    Local area

    ByteDance

    San Jose, CA
    1 day ago
  • $212.8k - $387.6k

     ...owners of the AI Compute layer and...  ..., and model serving—to power...  ...workloads in the world. Our...  ...cache systems, multimodal serving,...  ...workloads Bridging research...  ...scheduling technologies, build a heterogeneous...  ...scale model training and...  ...employment: Interacting and occasionally... 
    Training
    Temporary work
    Local area

    ByteDance

    San Jose, CA
    4 days ago
  • $147k - $211k

     ...seeking strong Research Scientists with...  ...sociotechnical modeling to join a multimodal safety research...  ...the interactions between AI and...  ...We use our technologies for widespread...  ...work in real-world impact on global...  ...learning, computer vision, and...  ...finetuning and post-training LLMs using... 
    Training
    Full time

    DeepMind

    Mountain View, CA
    1 day ago
  • $184k - $287.5k

     ...one of the technology industry’s...  ...Computing, Artificial...  ...people in the world. Join us at...  ...Learning Scientists to advance...  ...and agentic multimodal AI. You will...  ...help develop models capable of...  ...applied research to develop, train, fine-tune...  ...human-AI interaction.Proven ability... 
    Training
    Full time
    Work experience placement

    Nvidia

    Santa Clara, CA
    1 day ago
  • $156k - $316.8k

    Research Scientist — Privacy-Preserving Large-Scale Model Training & Architecture Optimization...  ...under real-world production...  ...long-sequence multimodal reasoning,...  ...between quality, compute efficiency,...  ...: Interacting and occasionally...  ...information technology systems; Exercising... 
    Training
    Temporary work
    Local area

    Ellis Technologies, Inc.

    San Jose, CA
    1 day ago
  • $55 per hour

    Research Scientist Intern - Multimodal Sensing & On-Device Perception Location: San Jose Team: Technology Employment Type: Intern Responsibilities...  .... Design and train machine learning models, utilizing computer vision and...  ...) Candidates: Interacting and occasionally... 
    Training
    Hourly pay
    Internship

    Socket.dev

    San Jose, CA
    3 days ago
  • $168k - $264.5k

     ...transforming computer graphics, PC gaming...  ...by great technology—and amazing people...  ...the world. Doing what’s...  ...team at NVIDIA Research, strive to lead...  ...intelligence and human interaction to shape...  ...team of research scientists and engineers...  ...Experience with AI model training and evaluation... 
    Training

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $244.8k

     ...Deeply involve in post‑training (SFT/RL) of Seed multimodal models and LLM....  ...training. Apply agent technology and architecture,...  ...conduct in‑depth research on agentic RL. Develop...  ..., diverse, and interactive multi‑modal data generation...  ...Development, Computer Science, Computer... 
    Training
    Temporary work
    Local area

    TikTok

    San Jose, CA
    1 day ago
  • $174k - $253k

     ...PhD degree in Computer Science or...  ...Information Technology) or equivalent...  ...Language Model. Preferred...  ...language, and multimodal research. 1 year of...  ...a Research Scientist, you'll setup...  ...work on real-world problems that...  ...or training. US: $17400...  ...working with pre‑training and... 
    Training

    Google DeepMind

    Mountain View, CA
    4 days ago
  • $244.8k

     ...focuses on applied research in Generative AI...  ...team works on multimodal foundation models, image and video...  ...design, and world models. About The...  ...through large‑scale training and post‑...  ...completed a PhD in Computer Science, Computer...  ...conditional offer: interacting with clients and... 
    Training
    Temporary work
    Local area

    TikTok

    San Jose, CA
    1 day ago
  • $60 per hour

     ...delivering a world-class search...  ...through advanced technologies in search...  ...recommendation, and multimodal understanding...  ...and researchers to solve challenging...  ...evolution of pre-trained large models, TikTok...  ...pursuing a PhD in Computer Science,...  ...employment: Interacting and occasionally... 
    Training
    Hourly pay
    Summer work
    Internship
    Local area

    TikTok

    San Jose, CA
    1 day ago
  • $145k - $250k

    Research Scientist Graduate- CV/NLP/Multimodal LLM,(Trust and Safety...  ...-the-art computer vision, NLP...  ...models and algorithms...  ...everyone in the world....  ...distributed model training framework...  ...scenarios, like pre-training,...  ...: Interacting and occasionally...  ...technology systems; and... 
    Training
    Full time
    Temporary work
    Fixed term contract
    Summer work
    Internship
    Local area
    Flexible hours

    TikTok

    San Jose, CA
    1 day ago
  • $272k - $431.25k

     ...foundation for a new generation of interactive world-model systems. With this release...  ...leader to transform this technology lead into an industry...  ..., and helps customers and researchers succeed with the stack....  ...forcing or causal-forcing style training, Gaussian splatting, NeRFs... 
    Training
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  •  ...entertain the world. Together, we...  ...cutting-edge technology. Come be a...  ...Representation Models team creates...  ...looking for a Research Scientist specializing...  ..., continuous pre-training, novel representation...  ...:Ph.D. in Computer Science or a...  ...vision or multimodal AIIndustry experience... 
    Training
    Hourly pay
    Full time
    Immediate start
    Flexible hours

    Netflix

    Los Gatos, CA
    4 days ago
  • $254.4k

    Tech Lead Research Scientist/Engineer, Neural...  ...and World Models - TikTok Location...  ...of digital interaction by...  ...Develop, train, adapt, and...  ...learning, computer graphics, robotics...  ...models, or multimodal transformers...  ...training, and pre-training...  ...information technology systems; and... 
    Training
    Temporary work

    TikTok

    San Jose, CA
    1 day ago
  •  ...of Foundation Models We are a dedicated research lab for building...  ...model training, alongside world-class researchers, data scientists, and engineers...  ...high-performance computing in deep learning...  ...state-of-the-art multimodal foundation...  ...data recipes for pre-training and... 
    Training

    Institute of Foundation Models

    Sunnyvale, CA
    2 days ago
  • $126k - $423k

     ...multiple passionate Research Scientists to join the...  ...create cutting‑edge technology enabling next‑generation...  ...research on pretraining world‑action foundation model with various world...  ...in the fields of computer vision, machine...  ...machine learning model training. Nice to have:... 
    Training
    Full time
    For contractors
    For subcontractor
    Casual work
    Work at office
    Immediate start
    Remote work
    Day shift

    Decisive Point

    Sunnyvale, CA
    3 days ago
  •  ...Foundation Models We are a dedicated research lab for building...  ...model training, alongside world-class researchers...  ..., data scientists, and...  ...performance computing in deep learning...  ...real-time interaction.  Areas of...  ...training multimodal LLMs and video...  ...video pre-training strategies... 
    Training
    Visa sponsorship

    Institute of Foundation Models

    Sunnyvale, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Scientist - Multimodal Interaction and World Model - Pre-Training Technology - Compute[...]. Be the first to apply!