Senior Research Scientist, Gemini Release Evaluations, DeepMind
$174k - $252kGoogle Inc.
Senior Research Scientist, Gemini Release Evaluations, DeepMind X Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Mountain View, CA, USA; New York, NY, USA; London, UK . PhD in Computer Science, a related field, or equivalent practical experience. 2 years of experience leading a research agenda. 1 year of experience in a data science field. Experience with AI model training, testing, evaluation, and tuning processes, as well as LLM release cycles and timeline management. Preferred qualifications: 2 years of coding experience. 1 year of experience leading research efforts and influencing other researchers. About the job Artificial intelligence will be one of humanity's most transformative inventions. At DeepMind, we are a pioneering AI lab with exceptional interdisciplinary teams focused on advancing AI development to solve complex global challenges and accelerate high-quality product innovation for billions of users. We use our technologies for widespread public benefit and scientific discovery, ensuring safety and ethics are always our highest priority. We are pushing the boundaries across multiple domains. Our global teams offer learning opportunities and varied career pathways for those driven to achieve exceptional results through collective effort. Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $174000 - $252000 (USD) + 15% bonus target + equity + benefits Learn more about benefits at Google. Author research papers to share and generate impact of research results across function and in the research community. Drive project work by defining the data structure, framework, design, and evaluation metrics for research solution development and implementation. Identify timelines and obtain resources needed. Identify gaps in our existing release evals and create new SOTA datasets that push frontier models to their limits. Help build a deeper understanding of the relationship between static evaluations and live production traffic. Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy , Know your rights: workplace discrimination is illegal , Belonging at Google , and How we hire . Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting. To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes. Equity is granted exclusively and discretionarily by Alphabet Inc. on the basis of an agreement concluded between you and Alphabet Inc. Alphabet Inc. is your sole contractual partner with respect to equity grants. GSU grants are not guaranteed, are discretionary, are subject to approval by the Alphabet Inc. board of directors or its delegate, the terms of the relevant Alphabet Inc. stock plan, and your grant agreement. They have no impact on statutory payments. Current or past grants do not confer an acquired right. #J-18808-Ljbffr Google Inc.
- DeepMind is seeking a Senior Research Scientist to drive Gemini Release Evaluations. You will lead a research agenda, shape evaluation frameworks, and direct data-driven release cycles for large language models. The role demands a PhD or equivalent experience and strong...Senior
- Google's DeepMind is seeking a Senior Research Scientist for Gemini Release Evaluations to advance evaluation frameworks and data-driven insights for scalable AI systems. You will lead research initiatives, define evaluation metrics, coordinate with cross-functional teams...Senior
$174k - $252k
...experience. Experience conducting research or development in Speech... ...of work. As a Research Scientist, you'll setup large-scale tests... ...transformative inventions. At Google DeepMind, we are a pioneering AI lab... ...Create comprehensive evaluation sets and benchmarks to...Suggested- ...our customers. Cohere is a team of researchers, engineers, designers, and more, who... ...Germany and Paris. Join us!Why this role?Evaluation is critical to making progress in... ...to measure LLM progress.As a Senior Research Scientist, Model Evaluation, you will:Create ambitious...SeniorFull timeWork at officeLocal areaRemote workHome office
$174k - $253k
...tradeoffs in generative models.Translate research ideas into Gemini production codebase by solving... ...specific types of work. As a Research Scientist, you'll setup large-scale tests and deploy... ...transformative inventions. At Google DeepMind, we are a pioneering AI lab with...Suggested$174k - $253k
...About The Job Members of the team work on research and develop audio representations that... ...information within the audio signal to enable Gemini models to understand audio inputs and... ...transformative inventions. At Google DeepMind, we are a pioneering AI lab with exceptional...Senior$204k - $259k
Senior Research Scientist, Foundation Model (LLM/VLM) Waymo Position type: Full‑time Location: New... ...Design and run experiments training and evaluating large deep learning models Present... ...modeling and LLMs or VLMs (e.g., Gemini, Llama, GPT) Preferred Skills Post‑...SeniorFull time$147k - $211k
...systems. Experience conducting research and development, including... ...types of work. As a Research Scientist, you’ll set up large‑scale tests... ...inventions. At Google DeepMind, we are a pioneering AI lab with... ...Design, rapidly implement, and evaluate ideas, methods, interfaces,...Temporary work$192k - $304.75k
...engineering, and industrial simulation. We are seeking an applied researcher who can connect machine learning with numerical algorithms to... ...outputs, performance counters, and physics constraints.Define evaluation methods that measure numerical impact, including convergence...SeniorFull timeRemote work$192k - $304.75k
...computing. Today, we are building software, systems, and research platforms that help scientists and engineers solve problems that were once out of... ...precision algorithms, and sparse direct/iterative hybrids.Evaluate algorithms on workloads in mechanics, contact, thermal-...SeniorFull timeRemote work$216k - $270k
Scale Labs, Research Scientist — Frontier Risk EvaluationsAs the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and systems. Building on this expertise, Scale Labs...Full time- Vibrant Emotional Health is seeking a Lead Research Scientist to provide scientific leadership for a high-impact research and evaluation portfolio supporting the 988 Lifeline and related activities. You will guide analytic planning, oversee literature reviews, and serve...SeniorRemote job
$56.26 - $63.41 per hour
...Title: Senior Research Scientist - Temp Location: Upper East Side Org Unit: Neurological Surgery Work Days: Weekly Hours: 35.... ...experiments. Troubleshoots issues and recommends solutions. Evaluates experiment results using statistical and multivariate...SeniorTemporary workLocal area- ...team.KPMG is currently seeking an AI Research Scientist to join our Audit Technology Alliance... ...retrieval systems under the guidance of senior team membersCollaborate hands-on with... ...s research agenda by implementing and evaluating new techniques from academic literature...SeniorWork experience placementLocal area
$115k - $230k
...Culture, Great Rewards, and Great Careers. Job Title: Senior Research Scientist We are seeking a highly skilled Senior Research Scientist... ...~ Experience with GenAI quality management, including evaluators, red-teaming, guardrails, and human-in-the-loop systems....SeniorHourly payFull timeWork experience placementLocal area- Guild seeks Research Scientists to lead deep AI research and post-research implementation for the Apollo enterprise AI platform. Focus areas... ..., reinforcement learning systems, and comprehensive evaluation frameworks across models, inputs, and outputs. This discovery...Senior
$166k - $200k
We are seeking Research Scientists to lead deep, foundational AI research and post-research implementation that powers our next-generation... ...personality), reinforcement learning systems, and comprehensive evaluation frameworks across models, inputs, and outputs. This is not...SeniorTemporary workWork at officeRemote workShift work$200k - $320k
...to strengthen our expansive research team. We are looking for candidates... ...physicists, and computer scientists—who are passionate about... ...large data, and more. As a Senior Research Scientist you will... ...prototypes, run large‑scale evaluations, and drive the project through...SeniorWork at officeLocal areaRelocation$218.4k - $273k
...General Intelligence (AGI), and building upon our prior model evaluation work with enterprise customers and governments, to deepen our... ...Agent Capabilities & Environments (ACE) team, part of Scale’s Research organization, brings together customer-facing Researchers and...SeniorFull time- ...Center U.S., Inc. in New York, NY is seeking an Applied Scientist III to design, develop, evaluate and deploy data-driven ML and NL solutions. You will... ...experiments. You will mentor junior engineers and researchers, collaborate across teams, and may telecommute. This...SeniorFull timeRemote work
$183.8k - $248.7k
We are seeking an Applied Scientist to lead the development of evaluation frameworks and data collection protocols for robotic capabilities. In this role,... ...qualifications- PhD, or Master's degree and 6+ years of applied research experience- 3+ years of industry or academic research...SeniorFlexible hours$167.4k - $310.8k
...discovery and development. Roche’s Research and Early Development... ...Intelligence (AI) to assist our scientists in both pRED and gRED to... ...techniques. We are seeking a Senior or Principal Machine Learning... ...architectures, training strategies, and evaluation methodologies.Model...SeniorFull timeLocal areaWorldwideRelocation package$146.8k - $272.6k
...at the forefront of applied research in an industry setting? TR Labs... ...Reuters. We are seeking scientists with a passion for solving problems... ....About the Role As a Senior Applied Scientist, you will lead... ...environmentsOutstanding technical judgment and evaluation expertiseExcellent...SeniorFull timeWork at officeLocal areaFlexible hours2 days per week3 days per week$80 per hour
...foundational AI lab to find experienced senior economists who can help train their latest... ...an economic consulting firm to create, evaluate, and refine AI-generated presentations... ...expert network built by a McKinsey/SoftBank/DeepMind team and backed by world-leading...SeniorImmediate startRemote workFlexible hours$200k - $240k
...scale. About the role: We are seeking an exceptional Applied Scientist to work on core search systems that power our product, with a... ...Garner selects high-value providers for members by developing the evaluation frameworks, objective functions, and algorithms that drive our...SeniorWork at officeWork visaFlexible hours3 days per week- ...The Research & Intelligence team builds the machine learning and semantic intelligence... ...data assets. We are seeking a Senior Applied Scientist to lead and expand key research directions... ...rigorous standards for model evaluation, monitoring, and lifecycle management...SeniorWork at officeLocal areaRemote work
$183.8k - $248.7k
...Description We are seeking a Sr. Applied Scientist to develop and optimize Visual Inertial... ...approaches Build and maintain calibration, evaluation, and benchmarking infrastructure for... ...autonomy stack Lead technical projects from research prototyping through production...SeniorFlexible hours- A health tech company in New York City is hiring a Research Scientist to evaluate the impact of ambient AI on healthcare outcomes. The role emphasizes designing studies, engaging with health systems, and fostering collaboration across product teams. A PhD in a relevant...Work at office
- Scale Labs, Research Scientist — Frontier Risk Evaluations As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and systems. Building on this expertise, Scale Labs...
- ...We are a growing team of practicing MDs, AI scientists, PhDs, creatives, technologists, and engineers... ...Liberty in Pittsburgh. The Role Abridge is hiring Research Scientists to join our Strategic Research team to rigorously evaluate and advance the real-world impact of ambient...Hourly payFull timeWork at officeRelocation packageFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Research Scientist, Gemini Release Evaluations, DeepMind. Be the first to apply!
- scientist ii New York, NY
- machine learning scientist New York, NY
- scientist New York, NY
- quality control scientist New York, NY
- qc scientist New York, NY
- regulatory scientist New York, NY
- research scientist - biology New York, NY
- applied scientist New York, NY
- associate scientist New York, NY
- operations research scientist New York, NY


