Senior Research Scientist, Gemini Release Evaluations, DeepMind
$174k - $252kGoogle DeepMind
Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Mountain View, CA, USA; New York, NY, USA; London, UK . Minimum qualifications PhD in Computer Science, a related field, or equivalent practical experience. 2 years of experience leading a research agenda. 1 year of experience in a data science field. Experience with AI model training, testing, evaluation, and tuning processes, as well as LLM release cycles and timeline management. Preferred qualifications 2 years of coding experience. 1 year of experience leading research efforts and influencing other researchers. About the job Artificial intelligence will be one of humanity's most transformative inventions. At DeepMind, we are a pioneering AI lab with exceptional interdisciplinary teams focused on advancing AI development to solve complex global challenges and accelerate high-quality product innovation for billions of users. We use our technologies for widespread public benefit and scientific discovery, ensuring safety and ethics are always our highest priority. We are pushing the boundaries across multiple domains. Our global teams offer learning opportunities and varied career pathways for those driven to achieve exceptional results through collective effort. Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $174000 - $252000 (USD) + 15% bonus target + equity + benefits Responsibilities Author research papers to share and generate impact of research results across function and in the research community. Drive project work by defining the data structure, framework, design, and evaluation metrics for research solution development and implementation. Identify timelines and obtain resources needed. Identify gaps in our existing release evals and create new SOTA datasets that push frontier models to their limits. Help build a deeper understanding of the relationship between static evaluations and live production traffic. Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also Google's EEO Policy and EEO is the Law. If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form. #J-18808-Ljbffr Google DeepMind
$174k - $252k
Senior Research Scientist, Gemini Release Evaluations, DeepMind X Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Mountain View, CA, USA; New York, NY, USA; London, UK . PhD in Computer Science...Senior- DeepMind is seeking a Senior Research Scientist to drive Gemini Release Evaluations. You will lead a research agenda, shape evaluation frameworks, and direct data-driven release cycles for large language models. The role demands a PhD or equivalent experience and strong...Senior
- Google's DeepMind is seeking a Senior Research Scientist for Gemini Release Evaluations to advance evaluation frameworks and data-driven insights for scalable AI systems. You will lead research initiatives, define evaluation metrics, coordinate with cross-functional teams...Senior
$174k - $252k
...experience. Experience conducting research or development in Speech... ...of work. As a Research Scientist, you'll setup large-scale tests... ...transformative inventions. At Google DeepMind, we are a pioneering AI lab... ...Create comprehensive evaluation sets and benchmarks to...Suggested- ...our customers. Cohere is a team of researchers, engineers, designers, and more, who... ...Germany and Paris. Join us!Why this role?Evaluation is critical to making progress in... ...to measure LLM progress.As a Senior Research Scientist, Model Evaluation, you will:Create ambitious...SeniorFull timeWork at officeLocal areaRemote workHome office
- Cohere is seeking a Senior Research Scientist, Model Evaluation, to create ambitious evaluation benchmarks and scale evaluation infrastructure for enterprise AI. You will work with cross-functional teams to translate model feedback into trustworthy measurements and to push...SeniorRemote work
$174k - $253k
...About The Job Members of the team work on research and develop audio representations that... ...information within the audio signal to enable Gemini models to understand audio inputs and... ...transformative inventions. At Google DeepMind, we are a pioneering AI lab with exceptional...Senior$204k - $259k
Senior Research Scientist, Foundation Model (LLM/VLM) Waymo Position type: Full‑time Location: New... ...Design and run experiments training and evaluating large deep learning models Present... ...modeling and LLMs or VLMs (e.g., Gemini, Llama, GPT) Preferred Skills Post‑...SeniorFull time$147k - $211k
...systems. Experience conducting research and development, including... ...types of work. As a Research Scientist, you’ll set up large‑scale tests... ...inventions. At Google DeepMind, we are a pioneering AI lab with... ...Design, rapidly implement, and evaluate ideas, methods, interfaces,...Temporary work$174k - $253k
...visual, language, and multimodal research. 1 year of experience... ...types of work. As a Research Scientist, you'll setup large-scale tests... ...transformative inventions. At Google DeepMind, we are a pioneering AI lab... ...research ideas into Gemini production codebase by solving...$192k - $304.75k
...computing. Today, we are building software, systems, and research platforms that help scientists and engineers solve problems that were once out of... ...precision algorithms, and sparse direct/iterative hybrids.Evaluate algorithms on workloads in mechanics, contact, thermal-...SeniorFull timeRemote work$216k - $270k
Scale Labs, Research Scientist — Frontier Risk EvaluationsAs the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and systems. Building on this expertise, Scale Labs...Full time$200k - $320k
...to strengthen our expansive research team. We are looking for candidates... ...physicists, and computer scientists-who are passionate about... ...large data, and more. As a Senior Research Scientist you will... ...prototypes, run large-scale evaluations, and drive the project through...SeniorWork at officeLocal areaRelocation$65k - $120k
...thousands of physicians and scientists who have helped to shape the... ...medical education, scientific research, and direct patient care. At... ...opportunity to join our team as a Senior Research Scientist within the... ...patient-centered data for evaluation of interventions and characteristics...Senior$80 per hour
...foundational AI lab to find experienced senior economists who can help train their latest... ...an economic consulting firm to create, evaluate, and refine AI-generated presentations... ...expert network built by a McKinsey/SoftBank/DeepMind team and backed by world-leading...SeniorImmediate startRemote workFlexible hours- Vibrant Emotional Health is seeking a Lead Research Scientist to provide scientific leadership for a high-impact research and evaluation portfolio supporting the 988 Lifeline and related activities. You will guide analytic planning, oversee literature reviews, and serve...SeniorRemote job
- ...team.KPMG is currently seeking an AI Research Scientist to join our Audit Technology Alliance... ...retrieval systems under the guidance of senior team membersCollaborate hands-on with... ...s research agenda by implementing and evaluating new techniques from academic literature...SeniorWork experience placementLocal area
$192k - $304.75k
Job Requisition ID: JR2023073 Job Category: Research Time Type: Full time At NVIDIA, we are using accelerated computing and machine... ..., performance counters, and physics constraints. Define evaluation methods that measure numerical impact, including convergence rate...SeniorFull time- Guild seeks Research Scientists to lead deep AI research and post-research implementation for the Apollo enterprise AI platform. Focus areas... ..., reinforcement learning systems, and comprehensive evaluation frameworks across models, inputs, and outputs. This discovery...Senior
$166k - $200k
We are seeking Research Scientists to lead deep, foundational AI research and post-research implementation that powers our next-generation... ...personality), reinforcement learning systems, and comprehensive evaluation frameworks across models, inputs, and outputs. This is not...SeniorTemporary workWork at officeRemote workShift work$147k - $211k
...Research Scientist, Multimodal Alignment, Safety, and Fairness Kirkland... ...research effort within Google DeepMind's Frontier AI unit. This... ...breakthrough improvements to models (Gemini) and products. Our work is... ...context and dynamically evaluate and evolve system behaviors...Full time$218.4k - $273k
...General Intelligence (AGI), and building upon our prior model evaluation work with enterprise customers and governments, to deepen our... ...Agent Capabilities & Environments (ACE) team, part of Scale’s Research organization, brings together customer-facing Researchers and...SeniorFull time$113.87k - $165.11k
About the Opportunity The Kostas Research Institute (KRI) at Northeastern University... ...with and support of KRI Senior R&D Engineers/Scientists for government and industry contracts... ...including model training, fine-tuning, evaluation, and experimentation. Experience working...SeniorWork experience placementWork at office$183.8k - $248.7k
We are seeking an Applied Scientist to lead the development of evaluation frameworks and data collection protocols for robotic capabilities. In this role,... ...qualifications- PhD, or Master's degree and 6+ years of applied research experience- 3+ years of industry or academic research...SeniorFlexible hours$146.8k - $272.6k
...at the forefront of applied research in an industry setting? TR Labs... ...Reuters. We are seeking scientists with a passion for solving problems... ....About the Role As a Senior Applied Scientist, you will lead... ...environmentsOutstanding technical judgment and evaluation expertiseExcellent...SeniorFull timeWork at officeLocal areaFlexible hours2 days per week3 days per week$167.4k - $310.8k
...discovery and development. Roche’s Research and Early Development... ...Intelligence (AI) to assist our scientists in both pRED and gRED to... ...techniques. We are seeking a Senior or Principal Machine Learning... ...architectures, training strategies, and evaluation methodologies.Model...SeniorFull timeLocal areaWorldwideRelocation package$80 per hour
...foundational AI lab to find experienced senior economists who can help train their latest... ...an economic consulting firm to create, evaluate, and refine AI-generated presentations... ...expert network built by a McKinsey/SoftBank/DeepMind team and backed by world-leading...SeniorImmediate startRemote workFlexible hours$200k - $240k
...scale. About the role: We are seeking an exceptional Applied Scientist to work on core search systems that power our product, with a... ...Garner selects high-value providers for members by developing the evaluation frameworks, objective functions, and algorithms that drive our...SeniorWork at officeWork visaFlexible hours3 days per week- ...The Research & Intelligence team builds the machine learning and semantic intelligence... ...data assets. We are seeking a Senior Applied Scientist to lead and expand key research directions... ...rigorous standards for model evaluation, monitoring, and lifecycle management...SeniorWork at officeLocal areaRemote work
- Scale Labs, Research Scientist — Frontier Risk Evaluations As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and systems. Building on this expertise, Scale Labs...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Research Scientist, Gemini Release Evaluations, DeepMind. Be the first to apply!
- scientist ii New York, NY
- machine learning scientist New York, NY
- scientist New York, NY
- quality control scientist New York, NY
- qc scientist New York, NY
- regulatory scientist New York, NY
- research scientist - biology New York, NY
- applied scientist New York, NY
- associate scientist New York, NY
- operations research scientist New York, NY

