Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Scientist: AI Environments & Benchmarks

Fleet AI, Inc.

Fleet AI, Inc. is seeking a Research Scientist to join their core research team in San Francisco. This role focuses on investigating how environments influence intelligence, handling your own research projects, and collaborating with leading labs. Key responsibilities include generating benchmarks to evaluate frontier models, automating environment construction for agent training, and developing effective reward signals. The position offers a highly competitive salary and equity, requiring significant ownership of research outcomes. #J-18808-Ljbffr Fleet AI, Inc.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Research Scientist: AI Environments & Benchmarks in San Francisco, CA vacancy
  • $150k - $250k

     ...Distyl AI Job Opportunity Distyl is an applied AI technology company partnering with...  ..., and global social organizations. We research and deploy technologies that power AI-native...  ...to drive incremental improvements on benchmarks or optimize an existing process but instead... 
    Suggested
    Work at office
    3 days per week

    Distyl AI

    San Francisco, CA
    1 day ago
  • $50 - $70 per hour

     ...proficiency in tools such as Esri ArcGIS and SAS. Offering a remote work arrangement, the compensation ranges from $50 to $70 per hour, transitioning based on quality work throughput. Applicants will undergo an AI interview as part of the process. #J-18808-Ljbffr Mercor
    Suggested
    Remote job
    Hourly pay

    Mercor

    San Francisco, CA
    4 days ago
  • $50 per hour

    A leading AI research firm is seeking PhDs in Mathematics or related fields for a fully remote contract role. The successful candidate will design advanced math problems to test AI performance and evaluate outputs for accuracy. Strong mathematical reasoning, problem-solving... 
    Suggested
    Remote job
    Contract work
    Flexible hours

    Turing

    San Francisco, CA
    3 days ago
  • $166k - $230k

     ...running the world’s best data and AI platform so our customers can...  ...missions. The Databricks AI Research organization enables...  ...production. As a Sr. Research Scientist on the Scaling team, you will...  ...empirically validate hypotheses and benchmark against state‑of‑the‑art... 
    Suggested
    Local area

    Menlo Ventures

    San Francisco, CA
    1 day ago
  • A leading AI evaluation firm based in San Francisco seeks a Machine Learning Scientist to foster understanding of AI model performance. You'll engage in designing and analyzing comprehensive experiments while collaborating across teams. Applicants should possess a PhD... 
    Suggested

    Arena Intelligence, Inc.

    San Francisco, CA
    4 days ago
  •  ...building the decision infrastructure layer for enterprise AI agents, and we are hiring a Research Scientist to advance the neuro-symbolic foundations of our...  ...production components with full observability and benchmarking. Engage with the Bay Area academic and industry AI... 
    Work at office
    Relocation

    Rippletide SAS

    San Francisco, CA
    1 day ago
  •  ...Department Technical About the Role Generative AI is transforming what's computationally...  ...through these bottlenecks. As an ML Research Scientist, you'll work at the frontier of...  ...and likelihood estimation Develop and benchmark novel solver methods for diffusion ODEs... 
    Full time
    Casual work
    Visa sponsorship

    Wheel the World

    San Francisco, CA
    5 days ago
  • $50 - $70 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam...  ...-science experts to design the environment, shape task scope, and review scenarios for... 
    Hourly pay
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    7 days ago
  •  ...Khosla Ventures-backed company building AI agents that reason about complex...  ...stealth mode. The Role We’re looking for research scientists who want to work at the intersection of...  ...Evaluation: Contributing to meaningful benchmarks and evaluation methods for domain-specific... 

    Xterraai

    San Francisco, CA
    2 days ago
  • $197.4k - $246.75k

    Scale Labs, Research Scientist — AI Controls and Monitoring As the leading data and evaluation partner...  ..., even in high‑stakes or adversarial environments. For example, you might: Develop...  ...researchers to establish standards and benchmarks for AI monitoring and escalation.... 

    Scale AI, Inc.

    San Francisco, CA
    3 days ago
  • $315k - $340k

     ...interpretable, and steerable AI systems. We want AI to...  ...group of committed researchers, engineers, policy...  ...The Role As a Research Scientist/Engineer focused on...  ...comprehensive honesty benchmarks and evaluation frameworks...  ...and test novel RL environments that reward truthful outputs... 
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    3 days ago
  • $350k

     ...interpretable, and steerable AI systems. We want AI to be...  ...growing group of committed researchers, engineers, policy experts,...  ...stack Thrive in fast-moving environments where the most important problem...  ..., from performance benchmarking to kernel optimization GPUs... 
    Full time
    Work at office
    Visa sponsorship
    Flexible hours
    Shift work

    Menlo Ventures

    San Francisco, CA
    5 days ago
  •  ...Team The Future of Computing Research team is an applied research team...  ...the frontier of multimodal AI, helping turn emerging model...  ...looking for a Research Engineer / Scientist to join the Future of...  ...: success is not just higher benchmark performance, but better model... 
    Work at office
    Immediate start
    Relocation package

    OpenAI

    San Francisco, CA
    4 days ago
  • $200k - $280k

     ...and/or training stack. Have a solid research foundation in your area(s) of depth:...  ...and APIs as needed. Establish metrics, benchmarks, and experimentation frameworks to validate...  ...performance engineering. About Together AI Together AI is a research-driven... 
    Full time

    Together AI

    San Francisco, CA
    2 days ago
  • A leading AI evaluation company is looking for a Staff Machine Learning Research Scientist to advance LLM evaluation methodologies. This role involves designing benchmarks, collaborating with teams, and mentoring others. Ideal candidates have significant experience in NLP... 

    Scale AI, Inc.

    San Francisco, CA
    3 days ago
  •  ...Senior / Principal ML Scientist Merge Labs is a frontier research lab with the mission of bridging biological and...  ...bandwidth, integrate with advanced AI, and are ultimately safe and accessible...  ...internal and public datasets; benchmark and validate model performance.... 

    Merge Labs, Inc.

    San Francisco, CA
    3 days ago
  • Member of Technical Staff - Research Scientist Patronus AI is a frontier lab developing simulation research...  ...standard for robust, high quality environments. Your work will inform how frontier...  ...research outcomes such as papers, benchmarks, datasets, and platform features.... 

    Patronus AI, Inc.

    San Francisco, CA
    3 days ago
  • $250k - $325k

     ...was first‑to‑market with An AI agent that lives in MS Word...  ...Role: Why, What, and Who AI researchers are the engine of innovation...  ...designing and maintaining datasets, benchmarks, and evals for training and...  ...‑paced startup or research environments. You’ll Thrive At Ivo If... 
    Contract work
    Work at office
    Immediate start
    Remote work

    Icehouseventures

    San Francisco, CA
    2 days ago
  • $150k - $250k

    About Distyl AI Distyl is an applied AI technology company partnering with the world’...  ...goods, and global social organizations. We research and deploy technologies that power AI-...  ...want to drive incremental improvements on benchmarks or optimize an existing process but... 
    Work at office
    3 days per week

    Distyl AI

    San Francisco, CA
    5 days ago
  • $100k - $300k

    Cogent Security is seeking a Research Scientist in San Francisco to conduct high-impact research in automated reasoning and AI-driven security. The ideal candidate will have extensive experience in static/dynamic analysis and a strong publication record in top-tier conferences... 

    Cogent Security

    San Francisco, CA
    2 days ago
  • A leading AI research company in San Francisco is seeking a Researcher to join their Physical AI team. As a Researcher, you will define...  ...conferences. Benefits include competitive compensation, healthcare, and a collaborative work environment. #J-18808-Ljbffr Hedra, Inc

    Hedra, Inc

    San Francisco, CA
    3 days ago
  • $114.2k - $306.6k

     ...to ensure you are not duplicating efforts.*Salesforce Research advances state-of-the-art AI techniques, developing models and prototypes that pave...  ...Salesforce AI Research is looking for outstanding AI Research Scientists / Research Engineers.**Our team discovers new research... 
    Full time

    Niebles

    San Francisco, CA
    3 days ago
  • $150k - $230k

    EliseAI in San Francisco is seeking a junior research scientist to engage in groundbreaking research on machine learning and large language...  ...0,000, the role allows for growth within a vibrant startup environment. Benefits include full medical coverage, equity options,... 

    EliseAI

    San Francisco, CA
    5 days ago
  • $340k - $425k

    A tech research firm in San Francisco is looking for a Research Engineer to join their Pre-training team. The ideal candidate will have an...  ..., and optimizing training infrastructure. A commitment to AI safety and the societal impacts of AI work is essential. Competitive... 

    Menlo Ventures

    San Francisco, CA
    4 days ago
  • A leading medical AI platform in Miami seeks a passionate Research Scientist to push boundaries and drive innovative solutions. The role involves end-to-end...  ...autonomous, ambitious, and ready to work in a fast-paced environment. The team is driven by excellence and aims to... 

    OpenEvidence

    San Francisco, CA
    2 days ago
  • A leading AI research firm in San Francisco seeks a Researcher to define and lead research in action-conditioned world models and generative...  ...compensation and benefits such as healthcare and a flexible work environment are offered. #J-18808-Ljbffr AI Chopping Block, Inc.
    Flexible hours

    AI Chopping Block, Inc.

    San Francisco, CA
    1 day ago
  • Stars Arena, based in San Francisco, is seeking a highly accomplished machine learning researcher to explore fundamental questions of intelligence. You will lead software development aimed at achieving human-level intelligence and mentor a small team of research engineers... 

    Stars Arena

    San Francisco, CA
    1 day ago
  • Wheel the World seeks a full-time ML Research Scientist in San Francisco to advance generative AI and quantum computing. This role involves developing theoretical...  ...and JAX. The company offers an innovative environment with unlimited PTO, competitive compensation, and... 
    Full time
    Visa sponsorship

    Wheel the World

    San Francisco, CA
    5 days ago
  • David Joseph & Company is recruiting for AfterQuery, seeking a Research Scientist - Post Training in San Francisco. The role is focused on conducting hands-on experiments to validate the impact of datasets on model performance. Candidates should have a solid background... 

    David Joseph & Company

    San Francisco, CA
    5 days ago
  • Patronus AI, Inc. is seeking a Member of Technical Staff - Research Scientist to lead advanced research in AI. This role involves designing and implementing scalable simulations and reinforcement learning systems. The ideal candidate will possess a relevant degree and... 

    Patronus AI, Inc.

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Scientist: AI Environments & Benchmarks. Be the first to apply!