Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Research Scientist, Gemini Release Evaluations, DeepMind

$174k - $252k

Google Inc.

Senior Research Scientist, Gemini Release Evaluations, DeepMind X Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Mountain View, CA, USA; New York, NY, USA; London, UK . PhD in Computer Science, a related field, or equivalent practical experience. 2 years of experience leading a research agenda. 1 year of experience in a data science field. Experience with AI model training, testing, evaluation, and tuning processes, as well as LLM release cycles and timeline management. Preferred qualifications: 2 years of coding experience. 1 year of experience leading research efforts and influencing other researchers. About the job Artificial intelligence will be one of humanity's most transformative inventions. At DeepMind, we are a pioneering AI lab with exceptional interdisciplinary teams focused on advancing AI development to solve complex global challenges and accelerate high-quality product innovation for billions of users. We use our technologies for widespread public benefit and scientific discovery, ensuring safety and ethics are always our highest priority. We are pushing the boundaries across multiple domains. Our global teams offer learning opportunities and varied career pathways for those driven to achieve exceptional results through collective effort. Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $174000 - $252000 (USD) + 15% bonus target + equity + benefits Learn more about benefits at Google. Author research papers to share and generate impact of research results across function and in the research community. Drive project work by defining the data structure, framework, design, and evaluation metrics for research solution development and implementation. Identify timelines and obtain resources needed. Identify gaps in our existing release evals and create new SOTA datasets that push frontier models to their limits. Help build a deeper understanding of the relationship between static evaluations and live production traffic. Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy , Know your rights: workplace discrimination is illegal , Belonging at Google , and How we hire . Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting. To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes. Equity is granted exclusively and discretionarily by Alphabet Inc. on the basis of an agreement concluded between you and Alphabet Inc. Alphabet Inc. is your sole contractual partner with respect to equity grants. GSU grants are not guaranteed, are discretionary, are subject to approval by the Alphabet Inc. board of directors or its delegate, the terms of the relevant Alphabet Inc. stock plan, and your grant agreement. They have no impact on statutory payments. Current or past grants do not confer an acquired right. #J-18808-Ljbffr Google Inc.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Research Scientist, Gemini Release Evaluations, DeepMind in New York, NY vacancy
  • DeepMind is seeking a Senior Research Scientist to drive Gemini Release Evaluations. You will lead a research agenda, shape evaluation frameworks, and direct data-driven release cycles for large language models. The role demands a PhD or equivalent experience and strong... 
    Senior

    Google Inc.

    New York, NY
    1 day ago
  • Google's DeepMind is seeking a Senior Research Scientist for Gemini Release Evaluations to advance evaluation frameworks and data-driven insights for scalable AI systems. You will lead research initiatives, define evaluation metrics, coordinate with cross-functional teams... 
    Senior

    Google

    New York, NY
    2 days ago
  • $174k - $252k

     ...experience. Experience conducting research or development in Speech...  ...of work. As a Research Scientist, you'll setup large-scale tests...  ...transformative inventions. At Google DeepMind, we are a pioneering AI lab...  ...Create comprehensive evaluation sets and benchmarks to... 
    Suggested

    Google Inc.

    New York, NY
    5 days ago
  •  ...our customers. Cohere is a team of researchers, engineers, designers, and more, who...  ...Germany and Paris. Join us!Why this role?Evaluation is critical to making progress in...  ...to measure LLM progress.As a Senior Research Scientist, Model Evaluation, you will:Create ambitious... 
    Senior
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    1 day ago
  • $174k - $253k

     ...tradeoffs in generative models.Translate research ideas into Gemini production codebase by solving...  ...specific types of work. As a Research Scientist, you'll setup large-scale tests and deploy...  ...transformative inventions. At Google DeepMind, we are a pioneering AI lab with... 
    Suggested

    Google

    New York, NY
    4 days ago
  • $174k - $253k

     ...About The Job Members of the team work on research and develop audio representations that...  ...information within the audio signal to enable Gemini models to understand audio inputs and...  ...transformative inventions. At Google DeepMind, we are a pioneering AI lab with exceptional... 
    Senior

    Google DeepMind

    New York, NY
    4 days ago
  • $204k - $259k

    Senior Research Scientist, Foundation Model (LLM/VLM) Waymo Position type: Full‑time Location: New...  ...Design and run experiments training and evaluating large deep learning models Present...  ...modeling and LLMs or VLMs (e.g., Gemini, Llama, GPT) Preferred Skills Post‑... 
    Senior
    Full time

    SupportFinity™

    New York, NY
    1 day ago
  • $147k - $211k

     ...systems. Experience conducting research and development, including...  ...types of work. As a Research Scientist, you’ll set up large‑scale tests...  ...inventions. At Google DeepMind, we are a pioneering AI lab with...  ...Design, rapidly implement, and evaluate ideas, methods, interfaces,... 
    Temporary work

    Google DeepMind

    New York, NY
    2 days ago
  • $192k - $304.75k

     ...engineering, and industrial simulation. We are seeking an applied researcher who can connect machine learning with numerical algorithms to...  ...outputs, performance counters, and physics constraints.Define evaluation methods that measure numerical impact, including convergence... 
    Senior
    Full time
    Remote work

    Nvidia

    New York, NY
    1 day ago
  • $192k - $304.75k

     ...computing. Today, we are building software, systems, and research platforms that help scientists and engineers solve problems that were once out of...  ...precision algorithms, and sparse direct/iterative hybrids.Evaluate algorithms on workloads in mechanics, contact, thermal-... 
    Senior
    Full time
    Remote work

    Nvidia

    New York, NY
    1 day ago
  • $216k - $270k

    Scale Labs, Research Scientist — Frontier Risk EvaluationsAs the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and systems. Building on this expertise, Scale Labs... 
    Full time

    Scale AI

    New York, NY
    2 days ago
  • Vibrant Emotional Health is seeking a Lead Research Scientist to provide scientific leadership for a high-impact research and evaluation portfolio supporting the 988 Lifeline and related activities. You will guide analytic planning, oversee literature reviews, and serve... 
    Senior
    Remote job

    Vibrant Emotional Health

    New York, NY
    5 days ago
  • $56.26 - $63.41 per hour

     ...Title: Senior Research Scientist - Temp Location: Upper East Side Org Unit: Neurological Surgery Work Days: Weekly Hours: 35....  ...experiments. Troubleshoots issues and recommends solutions. Evaluates experiment results using statistical and multivariate... 
    Senior
    Temporary work
    Local area

    Weill Cornell Medical College

    New York, NY
    5 days ago
  •  ...team.KPMG is currently seeking an AI Research Scientist to join our Audit Technology Alliance...  ...retrieval systems under the guidance of senior team membersCollaborate hands-on with...  ...s research agenda by implementing and evaluating new techniques from academic literature... 
    Senior
    Work experience placement
    Local area

    KPMG

    New York, NY
    1 day ago
  • $115k - $230k

     ...Culture, Great Rewards, and Great Careers. Job Title: Senior Research Scientist We are seeking a highly skilled Senior Research Scientist...  ...~ Experience with GenAI quality management, including evaluators, red-teaming, guardrails, and human-in-the-loop systems.... 
    Senior
    Hourly pay
    Full time
    Work experience placement
    Local area

    GEICO

    New York, NY
    3 days ago
  • Guild seeks Research Scientists to lead deep AI research and post-research implementation for the Apollo enterprise AI platform. Focus areas...  ..., reinforcement learning systems, and comprehensive evaluation frameworks across models, inputs, and outputs. This discovery... 
    Senior

    Guild

    New York, NY
    1 day ago
  • $166k - $200k

    We are seeking Research Scientists to lead deep, foundational AI research and post-research implementation that powers our next-generation...  ...personality), reinforcement learning systems, and comprehensive evaluation frameworks across models, inputs, and outputs. This is not... 
    Senior
    Temporary work
    Work at office
    Remote work
    Shift work

    Guild

    New York, NY
    1 day ago
  • $200k - $320k

     ...to strengthen our expansive research team. We are looking for candidates...  ...physicists, and computer scientists—who are passionate about...  ...large data, and more. As a Senior Research Scientist you will...  ...prototypes, run large‑scale evaluations, and drive the project through... 
    Senior
    Work at office
    Local area
    Relocation

    EliseAI

    New York, NY
    1 day ago
  • $218.4k - $273k

     ...General Intelligence (AGI), and building upon our prior model evaluation work with enterprise customers and governments, to deepen our...  ...Agent Capabilities & Environments (ACE) team, part of Scale’s Research organization, brings together customer-facing Researchers and... 
    Senior
    Full time

    Scale AI

    New York, NY
    1 day ago
  •  ...Center U.S., Inc. in New York, NY is seeking an Applied Scientist III to design, develop, evaluate and deploy data-driven ML and NL solutions. You will...  ...experiments. You will mentor junior engineers and researchers, collaborate across teams, and may telecommute. This... 
    Senior
    Full time
    Remote work

    Amazon Science

    New York, NY
    1 day ago
  • $183.8k - $248.7k

    We are seeking an Applied Scientist to lead the development of evaluation frameworks and data collection protocols for robotic capabilities. In this role,...  ...qualifications- PhD, or Master's degree and 6+ years of applied research experience- 3+ years of industry or academic research... 
    Senior
    Flexible hours

    Amazon

    New York, NY
    3 days ago
  • $167.4k - $310.8k

     ...discovery and development. Roche’s Research and Early Development...  ...Intelligence (AI) to assist our scientists in both pRED and gRED to...  ...techniques. We are seeking a Senior or Principal Machine Learning...  ...architectures, training strategies, and evaluation methodologies.Model... 
    Senior
    Full time
    Local area
    Worldwide
    Relocation package

    Genentech

    New York, NY
    1 day ago
  • $146.8k - $272.6k

     ...at the forefront of applied research in an industry setting? TR Labs...  ...Reuters. We are seeking scientists with a passion for solving problems...  ....About the Role As a Senior Applied Scientist, you will lead...  ...environmentsOutstanding technical judgment and evaluation expertiseExcellent... 
    Senior
    Full time
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    Thomson Reuters

    New York, NY
    1 day ago
  • $80 per hour

     ...foundational AI lab to find experienced senior economists who can help train their latest...  ...an economic consulting firm to create, evaluate, and refine AI-generated presentations...  ...expert network built by a McKinsey/SoftBank/DeepMind team and backed by world-leading... 
    Senior
    Immediate start
    Remote work
    Flexible hours

    Ethos

    New York, NY
    2 days ago
  • $200k - $240k

     ...scale. About the role: We are seeking an exceptional Applied Scientist to work on core search systems that power our product, with a...  ...Garner selects high-value providers for members by developing the evaluation frameworks, objective functions, and algorithms that drive our... 
    Senior
    Work at office
    Work visa
    Flexible hours
    3 days per week

    Garner Health

    New York, NY
    5 days ago
  •  ...The Research & Intelligence team builds the machine learning and semantic intelligence...  ...data assets. We are seeking a Senior Applied Scientist to lead and expand key research directions...  ...rigorous standards for model evaluation, monitoring, and lifecycle management... 
    Senior
    Work at office
    Local area
    Remote work

    Carbon Arc

    New York, NY
    2 days ago
  • $183.8k - $248.7k

     ...Description We are seeking a Sr. Applied Scientist to develop and optimize Visual Inertial...  ...approaches Build and maintain calibration, evaluation, and benchmarking infrastructure for...  ...autonomy stack Lead technical projects from research prototyping through production... 
    Senior
    Flexible hours

    Amazon Science

    New York, NY
    5 days ago
  • A health tech company in New York City is hiring a Research Scientist to evaluate the impact of ambient AI on healthcare outcomes. The role emphasizes designing studies, engaging with health systems, and fostering collaboration across product teams. A PhD in a relevant... 
    Work at office

    Abridge

    New York, NY
    2 days ago
  • Scale Labs, Research Scientist — Frontier Risk Evaluations As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and systems. Building on this expertise, Scale Labs... 

    Scale AI, Inc.

    New York, NY
    4 days ago
  •  ...We are a growing team of practicing MDs, AI scientists, PhDs, creatives, technologists, and engineers...  ...Liberty in Pittsburgh. The Role Abridge is hiring Research Scientists to join our Strategic Research team to rigorously evaluate and advance the real-world impact of ambient... 
    Hourly pay
    Full time
    Work at office
    Relocation package
    Flexible hours

    Abridge

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Research Scientist, Gemini Release Evaluations, DeepMind. Be the first to apply!