Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Research Scientist, Gemini Release Evaluations, DeepMind

$174k - $252k

Google DeepMind

Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Mountain View, CA, USA; New York, NY, USA; London, UK . Minimum qualifications PhD in Computer Science, a related field, or equivalent practical experience. 2 years of experience leading a research agenda. 1 year of experience in a data science field. Experience with AI model training, testing, evaluation, and tuning processes, as well as LLM release cycles and timeline management. Preferred qualifications 2 years of coding experience. 1 year of experience leading research efforts and influencing other researchers. About the job Artificial intelligence will be one of humanity's most transformative inventions. At DeepMind, we are a pioneering AI lab with exceptional interdisciplinary teams focused on advancing AI development to solve complex global challenges and accelerate high-quality product innovation for billions of users. We use our technologies for widespread public benefit and scientific discovery, ensuring safety and ethics are always our highest priority. We are pushing the boundaries across multiple domains. Our global teams offer learning opportunities and varied career pathways for those driven to achieve exceptional results through collective effort. Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $174000 - $252000 (USD) + 15% bonus target + equity + benefits Responsibilities Author research papers to share and generate impact of research results across function and in the research community. Drive project work by defining the data structure, framework, design, and evaluation metrics for research solution development and implementation. Identify timelines and obtain resources needed. Identify gaps in our existing release evals and create new SOTA datasets that push frontier models to their limits. Help build a deeper understanding of the relationship between static evaluations and live production traffic. Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also Google's EEO Policy and EEO is the Law. If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form. #J-18808-Ljbffr Google DeepMind

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Research Scientist, Gemini Release Evaluations, DeepMind in New York, NY vacancy
  • $174k - $252k

    Senior Research Scientist, Gemini Release Evaluations, DeepMind X Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Mountain View, CA, USA; New York, NY, USA; London, UK . PhD in Computer Science... 
    Senior

    Google Inc.

    New York, NY
    4 days ago
  • DeepMind is seeking a Senior Research Scientist to drive Gemini Release Evaluations. You will lead a research agenda, shape evaluation frameworks, and direct data-driven release cycles for large language models. The role demands a PhD or equivalent experience and strong... 
    Senior

    Google Inc.

    New York, NY
    4 days ago
  • Google's DeepMind is seeking a Senior Research Scientist for Gemini Release Evaluations to advance evaluation frameworks and data-driven insights for scalable AI systems. You will lead research initiatives, define evaluation metrics, coordinate with cross-functional teams... 
    Senior

    Google

    New York, NY
    15 hours ago
  • $174k - $252k

     ...experience. Experience conducting research or development in Speech...  ...of work. As a Research Scientist, you'll setup large-scale tests...  ...transformative inventions. At Google DeepMind, we are a pioneering AI lab...  ...Create comprehensive evaluation sets and benchmarks to... 
    Suggested

    Google Inc.

    New York, NY
    3 days ago
  •  ...our customers. Cohere is a team of researchers, engineers, designers, and more, who...  ...Germany and Paris. Join us!Why this role?Evaluation is critical to making progress in...  ...to measure LLM progress.As a Senior Research Scientist, Model Evaluation, you will:Create ambitious... 
    Senior
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    4 days ago
  • Cohere is seeking a Senior Research Scientist, Model Evaluation, to create ambitious evaluation benchmarks and scale evaluation infrastructure for enterprise AI. You will work with cross-functional teams to translate model feedback into trustworthy measurements and to push... 
    Senior
    Remote work

    cohere

    New York, NY
    3 days ago
  • $174k - $253k

     ...About The Job Members of the team work on research and develop audio representations that...  ...information within the audio signal to enable Gemini models to understand audio inputs and...  ...transformative inventions. At Google DeepMind, we are a pioneering AI lab with exceptional... 
    Senior

    Google DeepMind

    New York, NY
    2 days ago
  • $204k - $259k

    Senior Research Scientist, Foundation Model (LLM/VLM) Waymo Position type: Full‑time Location: New...  ...Design and run experiments training and evaluating large deep learning models Present...  ...modeling and LLMs or VLMs (e.g., Gemini, Llama, GPT) Preferred Skills Post‑... 
    Senior
    Full time

    SupportFinity™

    New York, NY
    4 days ago
  • $147k - $211k

     ...systems. Experience conducting research and development, including...  ...types of work. As a Research Scientist, you’ll set up large‑scale tests...  ...inventions. At Google DeepMind, we are a pioneering AI lab with...  ...Design, rapidly implement, and evaluate ideas, methods, interfaces,... 
    Temporary work

    Google DeepMind

    New York, NY
    15 hours ago
  • $174k - $253k

     ...visual, language, and multimodal research. 1 year of experience...  ...types of work. As a Research Scientist, you'll setup large-scale tests...  ...transformative inventions. At Google DeepMind, we are a pioneering AI lab...  ...research ideas into Gemini production codebase by solving... 

    Google DeepMind

    New York, NY
    2 days ago
  • $192k - $304.75k

     ...computing. Today, we are building software, systems, and research platforms that help scientists and engineers solve problems that were once out of...  ...precision algorithms, and sparse direct/iterative hybrids.Evaluate algorithms on workloads in mechanics, contact, thermal-... 
    Senior
    Full time
    Remote work

    Nvidia

    New York, NY
    4 days ago
  • $216k - $270k

    Scale Labs, Research Scientist — Frontier Risk EvaluationsAs the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and systems. Building on this expertise, Scale Labs... 
    Full time

    Scale AI

    New York, NY
    15 hours ago
  • $200k - $320k

     ...to strengthen our expansive research team. We are looking for candidates...  ...physicists, and computer scientists-who are passionate about...  ...large data, and more. As a Senior Research Scientist you will...  ...prototypes, run large-scale evaluations, and drive the project through... 
    Senior
    Work at office
    Local area
    Relocation

    EliseAI

    New York, NY
    3 days ago
  • $65k - $120k

     ...thousands of physicians and scientists who have helped to shape the...  ...medical education, scientific research, and direct patient care. At...  ...opportunity to join our team as a Senior Research Scientist within the...  ...patient-centered data for evaluation of interventions and characteristics... 
    Senior

    NYULMC

    New York, NY
    1 day ago
  • $80 per hour

     ...foundational AI lab to find experienced senior economists who can help train their latest...  ...an economic consulting firm to create, evaluate, and refine AI-generated presentations...  ...expert network built by a McKinsey/SoftBank/DeepMind team and backed by world-leading... 
    Senior
    Immediate start
    Remote work
    Flexible hours

    Ethos

    New York, NY
    5 days ago
  • Vibrant Emotional Health is seeking a Lead Research Scientist to provide scientific leadership for a high-impact research and evaluation portfolio supporting the 988 Lifeline and related activities. You will guide analytic planning, oversee literature reviews, and serve... 
    Senior
    Remote job

    Vibrant Emotional Health

    New York, NY
    3 days ago
  •  ...team.KPMG is currently seeking an AI Research Scientist to join our Audit Technology Alliance...  ...retrieval systems under the guidance of senior team membersCollaborate hands-on with...  ...s research agenda by implementing and evaluating new techniques from academic literature... 
    Senior
    Work experience placement
    Local area

    KPMG

    New York, NY
    10 hours ago
  • $192k - $304.75k

    Job Requisition ID: JR2023073 Job Category: Research Time Type: Full time At NVIDIA, we are using accelerated computing and machine...  ..., performance counters, and physics constraints. Define evaluation methods that measure numerical impact, including convergence rate... 
    Senior
    Full time

    NVIDIA AI

    New York, NY
    4 days ago
  • Guild seeks Research Scientists to lead deep AI research and post-research implementation for the Apollo enterprise AI platform. Focus areas...  ..., reinforcement learning systems, and comprehensive evaluation frameworks across models, inputs, and outputs. This discovery... 
    Senior

    Guild

    New York, NY
    4 days ago
  • $166k - $200k

    We are seeking Research Scientists to lead deep, foundational AI research and post-research implementation that powers our next-generation...  ...personality), reinforcement learning systems, and comprehensive evaluation frameworks across models, inputs, and outputs. This is not... 
    Senior
    Temporary work
    Work at office
    Remote work
    Shift work

    Guild

    New York, NY
    4 days ago
  • $147k - $211k

     ...Research Scientist, Multimodal Alignment, Safety, and Fairness Kirkland...  ...research effort within Google DeepMind's Frontier AI unit. This...  ...breakthrough improvements to models (Gemini) and products. Our work is...  ...context and dynamically evaluate and evolve system behaviors... 
    Full time

    DeepMind

    New York, NY
    3 days ago
  • $218.4k - $273k

     ...General Intelligence (AGI), and building upon our prior model evaluation work with enterprise customers and governments, to deepen our...  ...Agent Capabilities & Environments (ACE) team, part of Scale’s Research organization, brings together customer-facing Researchers and... 
    Senior
    Full time

    Scale AI

    New York, NY
    4 days ago
  • $113.87k - $165.11k

    About the Opportunity The Kostas Research Institute (KRI) at Northeastern University...  ...with and support of KRI Senior R&D Engineers/Scientists for government and industry contracts...  ...including model training, fine-tuning, evaluation, and experimentation. Experience working... 
    Senior
    Work experience placement
    Work at office

    Dormont Manufacturing Co

    New York, NY
    3 days ago
  • $183.8k - $248.7k

    We are seeking an Applied Scientist to lead the development of evaluation frameworks and data collection protocols for robotic capabilities. In this role,...  ...qualifications- PhD, or Master's degree and 6+ years of applied research experience- 3+ years of industry or academic research... 
    Senior
    Flexible hours

    Amazon

    New York, NY
    1 day ago
  • $146.8k - $272.6k

     ...at the forefront of applied research in an industry setting? TR Labs...  ...Reuters. We are seeking scientists with a passion for solving problems...  ....About the Role As a Senior Applied Scientist, you will lead...  ...environmentsOutstanding technical judgment and evaluation expertiseExcellent... 
    Senior
    Full time
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    Thomson Reuters

    New York, NY
    4 days ago
  • $167.4k - $310.8k

     ...discovery and development. Roche’s Research and Early Development...  ...Intelligence (AI) to assist our scientists in both pRED and gRED to...  ...techniques. We are seeking a Senior or Principal Machine Learning...  ...architectures, training strategies, and evaluation methodologies.Model... 
    Senior
    Full time
    Local area
    Worldwide
    Relocation package

    Genentech

    New York, NY
    4 days ago
  • $80 per hour

     ...foundational AI lab to find experienced senior economists who can help train their latest...  ...an economic consulting firm to create, evaluate, and refine AI-generated presentations...  ...expert network built by a McKinsey/SoftBank/DeepMind team and backed by world-leading... 
    Senior
    Immediate start
    Remote work
    Flexible hours

    Ethos

    New York, NY
    15 hours ago
  • $200k - $240k

     ...scale. About the role: We are seeking an exceptional Applied Scientist to work on core search systems that power our product, with a...  ...Garner selects high-value providers for members by developing the evaluation frameworks, objective functions, and algorithms that drive our... 
    Senior
    Work at office
    Work visa
    Flexible hours
    3 days per week

    Garner Health

    New York, NY
    3 days ago
  •  ...The Research & Intelligence team builds the machine learning and semantic intelligence...  ...data assets. We are seeking a Senior Applied Scientist to lead and expand key research directions...  ...rigorous standards for model evaluation, monitoring, and lifecycle management... 
    Senior
    Work at office
    Local area
    Remote work

    Carbon Arc

    New York, NY
    5 days ago
  • Scale Labs, Research Scientist — Frontier Risk Evaluations As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and systems. Building on this expertise, Scale Labs... 

    Scale AI, Inc.

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Research Scientist, Gemini Release Evaluations, DeepMind. Be the first to apply!