Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Scientist: AI Environments & Benchmarks

Fleet AI, Inc.

Fleet AI, Inc. is seeking a Research Scientist to join their core research team in San Francisco. This role focuses on investigating how environments influence intelligence, handling your own research projects, and collaborating with leading labs. Key responsibilities include generating benchmarks to evaluate frontier models, automating environment construction for agent training, and developing effective reward signals. The position offers a highly competitive salary and equity, requiring significant ownership of research outcomes. #J-18808-Ljbffr Fleet AI, Inc.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Research Scientist: AI Environments & Benchmarks in San Francisco, CA vacancy
  • $50 per hour

    A leading AI research firm is seeking PhDs in Mathematics or related fields for a fully remote contract role. The successful candidate will design advanced math problems to test AI performance and evaluate outputs for accuracy. Strong mathematical reasoning, problem-solving... 
    Suggested
    Remote job
    Contract work
    Flexible hours

    Turing

    San Francisco, CA
    4 days ago
  • $200k - $325k

     ...the Role We're looking for a Research Scientist to collaborate with partners...  ...of the next frontier benchmarks and datasets. This is a highly...  ...conversation around data‑centric AI. Preferred Qualifications...  ...fast‑moving, cross‑functional environment with ambiguous problem... 
    Suggested
    Local area

    Neura Market

    San Francisco, CA
    4 days ago
  • $200k - $325k

    Neura Market is seeking a Research Scientist to lead the development of benchmarks and datasets that impact the research community...  ...Candidates should have a strong AI/ML evaluation background,...  .... This position offers a dynamic environment and a salary range of $200,000 -... 
    Suggested

    Neura Market

    San Francisco, CA
    4 days ago
  •  ...Department Technical About the Role Generative AI is transforming what's computationally...  ...through these bottlenecks. As an ML Research Scientist, you'll work at the frontier of...  ...and likelihood estimation Develop and benchmark novel solver methods for diffusion ODEs... 
    Suggested
    Full time
    Casual work
    Visa sponsorship

    Wheel the World

    San Francisco, CA
    1 day ago
  • A leading AI evaluation firm based in San Francisco seeks a Machine Learning Scientist to foster understanding of AI model performance. You'll engage in designing and analyzing comprehensive experiments while collaborating across teams. Applicants should possess a PhD... 
    Suggested

    Arena Intelligence, Inc.

    San Francisco, CA
    19 hours ago
  • $350k

    Anthropic in San Francisco is seeking a Research Scientist/Engineer dedicated to enhancing...  ...inaccuracies and promote robust, honest AI systems, ensuring high standards are maintained...  ...classifiers, and creating honesty benchmarks. Strong programming skills, a relevant... 

    Anthropic

    San Francisco, CA
    3 days ago
  •  ...Khosla Ventures-backed company building AI agents that reason about complex...  ...stealth mode. The Role We’re looking for research scientists who want to work at the intersection of...  ...Evaluation: Contributing to meaningful benchmarks and evaluation methods for domain-specific... 

    Xterraai

    San Francisco, CA
    3 days ago
  •  ...Team The Future of Computing Research team is an applied research team...  ...the frontier of multimodal AI, helping turn emerging model...  ...looking for a Research Engineer / Scientist to join the Future of...  ...: success is not just higher benchmark performance, but better model... 
    Work at office
    Immediate start
    Relocation package

    Slope

    San Francisco, CA
    19 hours ago
  • $350k

     ...interpretable, and steerable AI systems. We want AI to...  ...group of committed researchers, engineers, policy...  ...the Role As a Research Scientist/Engineer focused on...  ...comprehensive honesty benchmarks and evaluation frameworks...  ...and test novel RL environments that reward truthful outputs... 
    Visa sponsorship

    Anthropic

    San Francisco, CA
    4 days ago
  • $315k - $340k

    [Expression of Interest] Research Scientist/Engineer, Honesty About Anthropic...  ..., and steerable AI systems. We want AI to be safe...  ...maintain comprehensive honesty benchmarks and evaluation frameworks Implement...  ...Develop and test novel RL environments that reward truthful outputs... 
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Menlo Ventures

    San Francisco, CA
    4 days ago
  • $216k - $270k

    SCALE LABS, RESEARCH SCIENTIST — AI CONTROLS AND MONITORING As the leading data and evaluation partner...  ...even in high-stakes or adversarial environments. For example, you might: * Develop...  ...to establish standards and benchmarks for AI monitoring and escalation. Ideally... 
    Full time

    Scale AI

    San Francisco, CA
    1 day ago
  •  ...leading enterprises orchestrate AI-powered work. Our vision is...  ...with AI. About the role AI research at WRITER isn't just about publishing...  .... As a staff AI research scientist, you'll be at the center of...  ...Build novel evaluation benchmarks and methodologies that push beyond... 
    Full time
    Work at office
    Local area
    Flexible hours

    WRITER

    San Francisco, CA
    9 days ago
  • Member of Technical Staff - Research Scientist Patronus AI is a frontier lab developing simulation research...  ...standard for robust, high quality environments. Your work will inform how frontier...  ...research outcomes such as papers, benchmarks, datasets, and platform features.... 

    Patronus AI, Inc.

    San Francisco, CA
    4 days ago
  • $350k

     ...reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial...  ...is a quickly growing group of committed researchers, engineers, policy experts, and business...  ...visual inputs Create evaluations and benchmarks that measure progress on multimodal... 
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    1 day ago
  •  ...Our mission is to architect AI that learns from and interacts...  ...Impact Conduct groundbreaking research in neural network...  ...adaptability across diverse deployment environments, from cloud to on‑device. Explore...  ...architectural innovations, benchmarking performance across research... 
    Work at office
    Visa sponsorship
    Flexible hours

    Cartesia AI, Inc.

    San Francisco, CA
    2 days ago
  • $250k - $325k

     ...was first-to-market with: An AI agent that lives in MS Word...  ...: Why, What, and Who Why AI Researchers are the engine of innovation...  ...and maintain datasets, benchmarks, and evals for training and...  ...fast-paced startup or research environments. You'll thrive at Ivo if:... 
    Contract work
    Work at office
    Immediate start
    Remote work

    Ivo Inc.

    San Francisco, CA
    4 days ago
  • $150k - $230k

    EliseAI in San Francisco is seeking a junior research scientist to engage in groundbreaking research on machine learning and large language...  ...0,000, the role allows for growth within a vibrant startup environment. Benefits include full medical coverage, equity options,... 

    EliseAI

    San Francisco, CA
    1 day ago
  • $340k - $425k

    A tech research firm in San Francisco is looking for a Research Engineer to join their Pre-training team. The ideal candidate will have an...  ..., and optimizing training infrastructure. A commitment to AI safety and the societal impacts of AI work is essential. Competitive... 

    Menlo Ventures

    San Francisco, CA
    19 hours ago
  • $235k - $270k

     ...Equity Merge Labs is a frontier research lab with the mission of...  ...bandwidth, integrate with advanced AI, and are ultimately safe and...  ...with engineers and data scientists. We work across disciplines to...  ...internal and public datasets; benchmark and validate performance. Serve... 
    Full time

    Slope

    San Francisco, CA
    2 days ago
  • $160k - $280k

     ...first time. We are a team of musicians and AI experts, including alumni from Spotify,...  ...Role We’re looking for early members of our research team. You’ll work closely with the...  ...of the art ML models trained with an H100/scientist ratio of >100x. Check out our Suno version... 
    Work at office
    Flexible hours

    Menlo Ventures

    San Francisco, CA
    3 days ago
  • Stars Arena, based in San Francisco, is seeking a highly accomplished machine learning researcher to explore fundamental questions of intelligence. You will lead software development aimed at achieving human-level intelligence and mentor a small team of research engineers... 

    Stars Arena

    San Francisco, CA
    2 days ago
  • Baseten in San Francisco is looking for a Research Scientist to drive innovative research in machine...  ...real-world challenges faced by our AI clients. The ideal candidate will have...  ...mentor others in a fast-paced startup environment. The role offers competitive compensation... 

    The Consensus

    San Francisco, CA
    1 day ago
  • Wheel the World seeks a full-time ML Research Scientist in San Francisco to advance generative AI and quantum computing. This role involves developing theoretical...  ...and JAX. The company offers an innovative environment with unlimited PTO, competitive compensation, and... 
    Full time
    Visa sponsorship

    Wheel the World

    San Francisco, CA
    1 day ago
  • A leading AI research company in San Francisco is seeking a Researcher to join their Physical AI team. As a Researcher, you will define...  ...conferences. Benefits include competitive compensation, healthcare, and a collaborative work environment. #J-18808-Ljbffr Hedra, Inc

    Hedra, Inc

    San Francisco, CA
    4 days ago
  • $114.2k - $306.6k

     ...to ensure you are not duplicating efforts.*Salesforce Research advances state-of-the-art AI techniques, developing models and prototypes that pave...  ...Salesforce AI Research is looking for outstanding AI Research Scientists / Research Engineers.**Our team discovers new research... 
    Full time

    Niebles

    San Francisco, CA
    4 days ago
  • $100k - $300k

    Cogent Security is seeking a Research Scientist in San Francisco to conduct high-impact research in automated reasoning and AI-driven security. The ideal candidate will have extensive experience in static/dynamic analysis and a strong publication record in top-tier conferences... 

    Cogent Security

    San Francisco, CA
    3 days ago
  • $350k

    Thinking Machines Lab in San Francisco is seeking a Pre-Training Researcher to advance AI methodologies and conduct experiments. The ideal candidate will have a Bachelor's degree in Computer Science or related fields and experience with deep learning frameworks. The role... 
    Visa sponsorship

    Thinking Machines Lab

    San Francisco, CA
    4 days ago
  • Job Title Founding Research Scientist Company Description Stealth physical AI startup Job Description You will lead the research function at a venture-backed...  ...a technical founding team in a high‑autonomy environment where you set the research direction and validation... 

    Jack & Jill

    San Francisco, CA
    19 hours ago
  • A leading medical AI platform in Miami seeks a passionate Research Scientist to push boundaries and drive innovative solutions. The role involves end-to-end...  ...autonomous, ambitious, and ready to work in a fast-paced environment. The team is driven by excellence and aims to... 

    OpenEvidence

    San Francisco, CA
    3 days ago
  • An innovative tech firm in San Francisco is seeking a Research Scientist to lead advancements in AI retrieval systems. You will design and implement...  ...performance and reliability in a fast-paced startup environment. Candidates should have a PhD or MS with 5+ years in... 
    Remote work
    Flexible hours

    Linkup

    San Francisco, CA
    19 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Scientist: AI Environments & Benchmarks. Be the first to apply!