Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Biology PhD — AI Evaluation Scientist & Coder

Mercor

Mercor is hiring PhD and Master's scientists to author AI evaluation tasks (Sci Code) for a benchmark in scientific computing. You will source material from papers, datasets, or open repositories and design scenarios for evaluation. Responsibilities include writing prompts, building grading criteria, and calibrating tasks so frontier models fail more often than they succeed, with a strong emphasis on biology domains. #J-18808-Ljbffr Mercor

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Biology PhD — AI Evaluation Scientist & Coder in New York, NY vacancy
  • $50 - $100 per hour

     ...their team part-time. Responsibilities include annotating and evaluating AI tool outputs, generating evaluation tasks, and conducting literature searches. Candidates should have a PhD or Masters in Biology or a related field and a strong interest in using AI to accelerate... 
    For phd
    Hourly pay
    Part time

    FutureHouse

    New York, NY
    2 days ago
  • $200k - $300k

     ...exponential progress in AI converges with central...  ...Summary Today's frontier biological AI models are trained...  ...Senior/Staff AI Research Scientist to join our...  ...models, training loops, and evaluation metrics. Bridge wet/dry...  ...Experience Research Experience: PhD in machine learning,... 
    For phd
    Immediate start
    Remote work

    Doist

    New York, NY
    4 days ago
  • Mercor is hiring PhD and Master's scientists to author AI evaluation tasks (Sci Code) Mercor is partnering with leading AI labs on a new benchmark for scientific...  ...in at least two subdomains (with a coding focus) Biology — ecology, biochemistry, genetics What you'll do... 
    For phd
    Part time
    Immediate start

    Mercor

    New York, NY
    1 day ago
  • $50 - $100 per hour

     ...expert biologists helping us improve and evaluate our AI tools! Benchmarking and training our...  ...expert researchers in various domains of biology. Responsibilities Annotating or evaluating...  ...results. Qualifications Have a PhD or Masters, or are pursuing either in Biology... 
    For phd
    Hourly pay
    Full time
    Contract work
    Part time

    FutureHouse

    New York, NY
    2 days ago
  • $175k - $250k

     ...environment, the Data Science team applies modern AI and machine learning techniques to develop...  ...workflows.Conduct applied research to evaluate new AI and machine learning techniques for...  ...research experience, along with an MS or PhD in Computer Science, Data Science,... 
    For phd
    Flexible hours

    Millennium Management

    New York, NY
    1 day ago
  • $274k - $376.2k

    Secure Every Identity, from AI to HumanIdentity is the key to unlocking...  ...for a Principal Applied AI Scientist to take product ideas from 0...  ...modelsCreate and maintain evaluation and training datasets and workflowsTake...  .../ applied research roles. A PhD is not required, we value... 
    For phd
    Work at office
    Local area
    Worldwide
    Flexible hours

    Okta

    New York, NY
    4 days ago
  • $320k - $400k

    As a Research Scientist on our team, you will partner with Research Engineers...  ...on our track record of AI-powered solutions (e.g., Bits...  ...environments, RL training loops, and evaluation infrastructure needed to train...  ...You Are:You hold a PhD in Computer Science, Machine Learning... 
    For phd

    Datadog

    New York, NY
    2 days ago
  • Mercor is seeking PhD and Master’s level scientists to author AI evaluation tasks for a new scientific benchmark. You will source materials from papers, datasets, or designs, and craft prompts and evaluation criteria for frontier models. The role emphasizes deep expertise... 
    For phd
    Part time
    Immediate start

    Mercor

    New York, NY
    2 days ago
  • $120k - $180k

    Get AI-powered advice on this job and more exclusive features....  ...EPM Scientific AI/ML Imaging Scientist A stealth-mode startup is developing...  ..., AI Research Agents - FAIR (PhD) New York, NY $117,000.00-$173...  ...ago AI Research Scientist - Evaluation, Handshake AI We’re unlocking... 
    For phd
    Full time

    EPM Scientific

    New York, NY
    2 days ago
  • $274k - $376.2k

     ...Secure Every Identity, from AI to Human Identity is the key...  ...looking for a Principal Applied AI Scientist to take product ideas from 0...  ...models Create and maintain evaluation and training datasets and...  ...ML / applied research roles. A PhD is not required, we value shipping... 
    For phd
    Work at office
    Local area
    Worldwide
    Flexible hours

    Okta

    New York, NY
    21 days ago
  • $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: Machine Learning Engineer — Model Evaluation & Experimentation Type: Contract...  ...Qualifications Must-Have ~ MSc or PhD in machine learning , computer science... 
    For phd
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    8 days ago
  • As a Research Scientist on our team, you will partner with Research Engineers...  ...on our track record of AI-powered solutions (e.g., Bits...  ...environments, RL training loops, and evaluation infrastructure needed to train...  .... Who You Are: You hold a PhD in Computer Science, Machine... 
    For phd

    Datadog

    New York, NY
    2 days ago
  • $196k - $269.5k

     ...ours. About the Role As a Senior Applied AI/ML Scientist on the Search Group, you’ll drive the...  ...retailers in browsing, filtering, and evaluation. Lead model development and GPU-based...  ...reviewed publications in ML/AI. MS or PhD in Computer Science, Statistics, or a related... 
    For phd
    Work experience placement
    Work at office
    Local area
    Immediate start
    Remote work
    Monday to Friday
    Flexible hours
    3 days per week

    Faire Inc

    New York, NY
    1 day ago
  • As a Senior AI Research Scientist, you will work closely with engineering teams to drive innovation...  ...to facilitate project progress. PHD degree or above in Computer Science, Mathematics...  ...observability, reliability, security, evaluation). Designed to replace parts of... 
    For phd

    CTW

    New York, NY
    2 days ago
  • $120k - $170k

     ...software. WhatYou’llBeLaunching As an AI Research Scientist, you will join the AI and Innovation department...  ...years' experience in similar role (or PhD with relevant research projects) AI/...  ...(connectors, simulation frameworks, evaluation harnesses) to refine simulation-based... 
    For phd
    Full time
    Work experience placement
    Currently hiring
    Remote work

    Slingshot Aerospace

    New York, NY
    3 days ago
  •  ...health tech company in New York City is hiring a Research Scientist to evaluate the impact of ambient AI on healthcare outcomes. The role emphasizes designing...  ..., and fostering collaboration across product teams. A PhD in a relevant field and strong quantitative skills are... 
    For phd
    Work at office

    Abridge

    New York, NY
    3 days ago
  • Scale AI, Inc. is looking for a Research Scientist focused on Frontier Risk Evaluations to develop evaluation measures and datasets for assessing AI risks. As a key team member, you will engage with government agencies and publish methodologies that influence AI safety... 

    Scale AI, Inc.

    New York, NY
    2 days ago
  • Scale Labs seeks a Research Scientist focused on Frontier Risk Evaluations to design evaluation measures, harnesses and datasets for measuring risks posed by frontier AI systems. You will build harnesses to test models, collaborate with government agencies to scope evaluations... 

    Scale

    New York, NY
    21 hours ago
  • $50 - $70 per hour

    United States Digital Space LLC is seeking a Data Scientist for AI Evaluation Analytics to work as a remote contractor on long-term projects. You will develop evaluation metrics, validate datasets, analyze signals, and apply statistical methods to measure AI system performance... 
    Remote job
    Hourly pay
    For contractors

    United States Digital Space LLC

    New York, NY
    21 hours ago
  • Omaze is looking for a Senior Applied AI Scientist to join their highly skilled Tech team. This role focuses on AI system evaluation, measurement, and optimization, combining data science with product engineering. You will work on evaluation frameworks for LLM features... 

    Omaze

    New York, NY
    21 hours ago
  •  ...semantic and knowledge architecture enabling AI-driven reasoning across the drug discovery...  ...enterprise knowledge models (discovery biology, toxicology, safety pharmacology, pathology...  .../platform teams. Required Qualifications PhD or Master’s in Biomedical Informatics, Bioinformatics... 
    For phd
    Immediate start

    Scorpion Therapeutics

    New York, NY
    1 day ago
  • $150k - $200k

     ...Palm Beach, FLThe Role: We are seeking an exceptionally talented AI Scientist to join the Artificial Intelligence team at WorldQuant. The...  ...members, researchers, and portfolio managersWhat You’ll Bring:PhD in a quantitative or highly analytical field (e.g., Computer Science... 
    For phd
    Work experience placement
    Casual work
    Flexible hours

    WorldQuant

    New York, NY
    2 days ago
  • $172.4k - $223.4k

    We are seeking a Robotics/AI Motor Control Scientist to develop cutting-edge machine learning algorithms for motor control systems in robots. In...  ...years of building models for business application experience- PhD, or Master's degree and 4+ years of CS, CE, ML or related... 
    For phd
    Flexible hours

    Amazon

    New York, NY
    1 day ago
  • Jobtailor in New Jersey, United States, seeks a PhD-level quantitative scientist to design evaluation frameworks for GenAI tools used in pharmaceutical R&D, reflecting domain-specific quality needs. You will build benchmark datasets, run expert reviews with cross-functional... 
    For phd

    Jobtailor

    New York, NY
    1 day ago
  • Parallel is looking for an experienced School Psychologist to provide psychological services and thorough evaluations for students across the United States. The role requires an EdS degree in school psychology and the ability to work directly with students under IEPs. Join... 
    For phd
    Remote job

    Parallel LLC

    New York, NY
    3 days ago
  • Mercor is hiring PhD and Master’s scientists to author AI evaluation tasks for a new benchmark in scientific computing. You will create original, executable...  ...repositories. Applicants should show deep expertise in biology and at least two subdomains, plus coding skills (... 
    For phd

    Obsidian

    New York, NY
    1 day ago
  • We are seeking an expert to evaluate and improve our AI models through comprehensive testing and analysis. You will be responsible for designing evaluation...  ...Document findings and recommendations Ideal Candidate PhD or Masters in Computer Science, ML, or related field 5+... 
    For phd

    MERIT Beauty

    New York, NY
    2 days ago
  • $30 - $50 per hour

    A tech company is seeking an AI Researcher to support end-to-end research for modern AI systems. This remote role involves designing experiments, defining evaluation protocols, and improving evaluation rigor for large language models. Key responsibilities include developing... 
    Remote job
    Hourly pay

    REX

    New York, NY
    2 days ago
  • Scale Labs seeks a Research Scientist focused on Agent Robustness in a multi-location setting...  ...fundamental challenges in building safe AI agents and aligning them with humans, including...  .... Some familiarity with agent evaluation tooling is a plus. #J-18808-Ljbffr Scale

    Scale

    New York, NY
    21 hours ago
  • Rex.zone is seeking an AI Research Scientist to lead applied AI research projects for US-based customers, translating open-ended questions into measurable experiments in LLM evaluation and RLHF data design. You will evaluate prompts, design datasets, and work with cross... 
    Remote job
    Hourly pay
    Flexible hours

    AIToolboard

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Biology PhD — AI Evaluation Scientist & Coder. Be the first to apply!