Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Scientist (Measurement and Evaluation)

Gravity Engineering Services Pvt Ltd.

About Abridge Abridge was founded in 2018 with the mission of powering deeper understanding in healthcare. Our AI-powered platform was purpose-built for medical conversations, improving clinical documentation efficiencies while enabling clinicians to focus on what matters most—their patients. Our enterprise-grade technology transforms patient-clinician conversations into structured clinical notes in real-time, with deep EMR integrations. Powered by Linked Evidence and our purpose-built, auditable AI, we are the only company that maps AI-generated summaries to ground truth, helping providers quickly trust and verify the output. As pioneers in generative AI for healthcare, we are setting the industry standards for the responsible deployment of AI across health systems. We are a growing team of practicing MDs, AI scientists, PhDs, creatives, technologists, and engineers working together to empower people and make care make more sense. We have offices located in the Mission District in San Francisco, the SoHo neighborhood of New York, and East Liberty in Pittsburgh. The Role Abridge is hiring Research Scientists to join our Strategic Research team to rigorously evaluate and advance the real-world impact of ambient AI on patient outcomes, care quality, and provider experience. In this role, you will design and lead empirical studies of Abridge models and products in partnership with health systems, leveraging large-scale clinical conversation data to generate new insights about care delivery, documentation quality, clinical decision-making, and downstream patient outcomes. You will operationalize complex constructs—such as quality of care, safety, cognitive burden, and return on investment—using principled measurement frameworks and rigorous experimental or quasi-experimental methods. Working closely with our science and product teams, you will also develop evaluation frameworks that inform model development and product strategy. Your work will contribute to broader scientific understanding of how AI systems affect patients and providers in the real world. This role sits at the intersection of methodological innovation and practical impact, applying serious measurement science to systems that directly shape patient care. About Strategic Research The Strategic Research team at Abridge has two primary functions: (i) designing and conducting rigorous research studies investigating the impact of ambient AI as an intervention in partnership with collaborating health systems; and (ii) supporting external research efforts that leverage Abridge data. In addition to driving and supporting empirical studies of the impact of ambient AI-enabled technologies, the team works closely with our science and engineering teams on core model evaluation. The common thread to all our work is ensuring that every partner-facing research initiative meets the highest standards of rigour, credibility, and strategic value. What You’ll Do Design and conduct evaluations of Abridge models and products Engage with external researchers and other stakeholders on designing and conducting research on ambient AI and research that leverages Abridge data Develop a strong user‑centric and patient‑centric mindset, grounding the research in empathy for the real world experience of providers and patients Collaborate across our cross‑functional product teams to ensure the research is deeply informed by current practices and our product roadmap Write technical reports and give presentations to internal and external stakeholders Actively contribute to the wider research community by publishing original research in leading peer‑reviewed publication venues Mentor research interns What You’ll Bring PhD in statistics, biostatistics, computer science, economics, information systems, clinical informatics, or a related field. Expertise in rigorous quantitative or mixed‑methods approaches for conducting evaluations using observational and experimental data. Strong research track record in evaluation and measurement, as evidenced by high‑impact publications at peer‑reviewed journals or conferences. A problem‑before‑method mindset. You do not change the question to make it amenable to simple analysis, but instead push the methodological frontier to solve the real world problems that matter to health systems, providers, and patients. A curious, adaptable, and proactive mindset, with a desire to learn and grow as a researcher in a fast‑paced startup environment. Passion for and understanding of Abridge’s mission. Must be willing to work from our New York City office at least 3x per week. This position requires a commitment to a hybrid work model, with the expectation of coming into the office a minimum of (3) three times per week. Relocation assistance is available for candidates willing to move to New York City. We value people who want to learn new things, and we know that great team members might not perfectly match a job description. If you’re interested in the role but aren’t sure whether or not you’re a good fit, we’d still like to hear from you. Why Work at Abridge At Abridge, we’re transforming healthcare delivery experiences with generative AI, enabling clinicians and patients to connect in deeper, more meaningful ways. Our mission is clear: to power deeper understanding in healthcare. We’re driving real, lasting change, with millions of medical conversations processed each month. Joining Abridge means stepping into a fast‑paced, high‑growth startup where your contributions truly make a difference. Our culture requires extreme ownership—every employee has the ability to (and is expected to) make an impact on our customers and our business. Beyond individual impact, you will have the opportunity to work alongside a team of curious, high‑achieving people in a supportive environment where success is shared, growth is constant, and feedback fuels progress. At Abridge, it’s not just what we do—it’s how we do it. Every decision is rooted in empathy, always prioritizing the needs of clinicians and patients. We’re committed to supporting your growth, both professionally and personally. Whether it's flexible work hours, an inclusive culture, or ongoing learning opportunities, we are here to help you thrive and do the best work of your life. If you are ready to make a meaningful impact alongside passionate people who care deeply about what they do, Abridge is the place for you. How we take care of Abridgers Generous Time Off : 14 paid holidays, flexible PTO for salaried employees, and accrued time off for hourly employees Comprehensive Health Plans : Medical, Dental, and Vision coverage for all full‑time employees and their families. Generous HSA Contribution : If you choose a High Deductible Health Plan, Abridge makes monthly contributions to your HSA. Paid Parental Leave : Generous paid parental leave for all full‑time employees. Family Forming Benefits : #J-18808-Ljbffr Gravity Engineering Services Pvt Ltd.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Research Scientist (Measurement and Evaluation) in New York, NY vacancy
  •  ...A health tech company in New York City is hiring a Research Scientist to evaluate the impact of ambient AI on healthcare outcomes. The role emphasizes designing studies, engaging with health systems, and fostering collaboration across product teams. A PhD in a relevant... 
    Suggested
    Work at office

    Abridge

    New York, NY
    2 days ago
  • Abridge is seeking a Research Scientist to evaluate the real-world impact of ambient AI on healthcare outcomes. This role involves designing empirical studies and collaborating with health systems to generate insights into care quality and patient experience. Applicants... 
    Suggested
    Work at office

    Gravity Engineering Services Pvt Ltd.

    New York, NY
    1 day ago
  • Scale Labs, Research Scientist — Frontier Risk Evaluations As the leading data and evaluation partner for frontier AI companies, Scale plays an integral...  ...labs to collectively scope and design evaluations to measure and mitigate risks posed by advanced AI systems. Publish... 
    Suggested

    Scale AI, Inc.

    New York, NY
    4 days ago
  • Senior Research Scientist, Model Evaluation Cohere | Posted Mar 2 | Full-time | New York | Negotiable | Unknown Why this role? Evaluation is critical...  ...‑generation evaluation methods and infrastructure to measure LLM progress. As a Senior Research Scientist, Model Evaluation... 
    Suggested
    Full time
    Work at office
    Remote work
    Flexible hours

    SupportFinity™

    New York, NY
    1 day ago
  •  ...Constructive Dialogue Institute (CDI) is seeking a Senior Impact Researcher to own the evaluation agenda end-to-end, designing and executing impact...  .... You will lead methodological work across design, measurement, data collection, analysis, and reporting while collaborating... 
    Suggested

    constructivedialogue

    New York, NY
    3 days ago
  • ICF Olson is seeking a seasoned evaluator to lead evaluations of federal initiatives from design through reporting. You will develop evaluation plans, logic models, and data-collection strategies while guiding analysis and writing reports. The role calls for strong communication... 
    Remote job

    ICF Olson

    New York, NY
    1 day ago
  • $30 - $50 per hour

    A tech company is seeking an AI Researcher to support end-to-end research for modern AI systems. This remote role involves designing experiments, defining evaluation protocols, and improving evaluation rigor for large language models. Key responsibilities include developing... 
    Remote job
    Hourly pay

    Rex.zone

    New York, NY
    1 day ago
  •  ...Join to apply for the Research Scientist role at Oumi 3 days ago Be among the first 25 applicants...  .../VLM development including training, evaluation, data curation, and benchmark...  ...Development: Develop evaluation benchmarks to measure the performance of LLMs across various... 
    Full time
    Worldwide

    Oumi

    New York, NY
    4 hours ago
  •  ...the role We’re looking for a top‑tier Research Scientist to join our tech team. Your core responsibilities...  ...for AI agents Prototype, train, and evaluate new models for factual search and...  ...and maintain an evaluations framework to measure the progress of our search engine... 
    Remote work
    Flexible hours

    Linkup Inc

    New York, NY
    1 day ago
  • $140k - $300k

     ...AI that ships, scales, and measurably improves how healthcare works...  ...toward the RS/RE blend – applied scientists who feel comfortable getting...  .... You’ll conduct applied research on real healthcare data,...  ...running large-scale training and evaluation on distributed... 
    Work at office
    Local area
    Flexible hours
    3 days per week

    Phare Health and R1 RCM

    New York, NY
    2 days ago
  •  ...Member of Technical Staff, Applied Research Scientist About Fleet We work with frontier labs,...  ...to build the environments, tasks, and evaluations that the next generation of agents are...  ...capability they're trying to teach or measure. Push back when the ask is wrong. Ship... 
    Local area
    Immediate start

    Fleet AI, Inc.

    New York, NY
    3 days ago
  • $175k - $250k

     ...prompt optimization, and agentic workflows. Conduct applied research to evaluate new AI and machine learning techniques for complex business...  ...for adoption. Design and implement evaluation frameworks to measure model quality, robustness, reliability, and business impact.... 
    Flexible hours

    Millennium

    New York, NY
    4 hours ago
  • DataAnnotation is seeking a Research Scientist (Chemistry) in the United States. The role involves training AI models by posing complex chemistry questions and evaluating their outputs. Applicants should possess a solid grounding in chemistry concepts and an ability to... 
    Remote job
    For contractors
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  • $40 per hour

    DataAnnotation is seeking a Clinical Researcher to assist in training AI models by measuring progress and evaluating outputs. The role allows candidates to work from home on their schedule, choosing projects that interest them. Applicants should have a strong background... 
    Remote job
    Hourly pay
    For contractors
    Work from home

    DataAnnotation

    New York, NY
    2 days ago
  • $147k - $211k

     ...Google maintains a portfolio of research projects driven by...  ...types of work. As a Research Scientist, you’ll set up large‑scale tests...  ...data pipelines. Develop better evaluation methods (human evaluation, auto...  ...raters, automated metrics) to measure quality of open‑ended audio... 

    Google Inc.

    New York, NY
    4 days ago
  •  ...Biological Safety Research Scientist San Francisco, CA About the Role We are looking...  ...Design and execute capability evaluations ("evals") to assess the capabilities...  ...both "reading" (e.g. high-throughput measurement, functional assays) and "writing" (gene... 
    Work at office
    Visa sponsorship
    Flexible hours
    Shift work

    anthropic

    New York, NY
    15 hours ago
  • $143.63k - $299.38k

     ...involves but not limited to, data collection, evaluation mechanism and production serving strategy. Ability...  ...and experiments to analyze problems and measure results Collaborate with engineering teams to put research results into action Explain complex ML concepts... 
    Work at office
    Flexible hours

    Yahoo Holdings Inc.

    New York, NY
    1 day ago
  •  ...the Role We're looking for an applied research scientist to join our small, high-leverage...  ...production infrastructure, and build the evaluation frameworks needed to trust and ship those...  ...or MarTech Experience with marketing measurement (attribution, incrementality,... 
    Work at office
    3 days per week

    SwiftCruit

    New York, NY
    4 days ago
  • $40 per hour

    A leading AI training company is looking for a Research Scientist (Biology) to evaluate AI models. This role involves testing chatbots with complex biology questions and requires strong expertise in biology and related fields. Candidates must be fluent in English and detail... 
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    3 days ago
  • $40 per hour

     ...DataAnnotation is seeking a Biotechnology R&D Scientist to train AI models. In this role, you will evaluate the outputs of AI chatbots and assess their logic to improve model quality. The ideal candidate should have a deep understanding of cell biology, genetics, biochemistry... 
    Hourly pay
    For contractors
    Remote work

    DataAnnotation

    New York, NY
    4 days ago
  • $40 per hour

    A technology firm specializing in AI is looking for a Research Scientist (Chemistry) to join their team. This role involves training AI models by evaluating chatbot outputs on complex chemistry questions. The candidate should possess a solid understanding of chemistry... 
    Hourly pay
    Contract work
    Remote work

    DataAnnotation

    New York, NY
    3 days ago
  • $196k - $230k

     ...work. About The Role We’re seeking an experienced UX Researcher to define and scale how we evaluate Notion’s AI‑powered experiences—focusing on what “...  ...those insights into reusable rubrics, workflows, and measurement approaches that product, design, engineering, and... 
    Local area
    Shift work

    Notion, LLC

    New York, NY
    2 days ago
  •  ...world datasets used to train, evaluate, and deploy robotic systems....  ...Our work sits directly between research, data, and real-world...  ...each other. We chase reality — measured, not assumed — and kill our own...  ...We are looking for a Research Scientist, Video Understanding to own Mecka... 

    mecka

    New York, NY
    4 days ago
  • $174k - $253k

    Gemini Audio Research Scientist, DeepMind Note: By applying to this position you will have an opportunity...  ...processing. Experience training or evaluating large language models (LLMs)....  ...methods (human and automated metrics) to measure quality. Help in growing research... 

    Google

    New York, NY
    1 day ago
  • $90k - $120k

     ...considering a career with the Research Foundation of The City...  ...before available at CUNY, allow scientists to expand the scope and scale...  ...and targets;Implements measures to maximize equipment usage...  ...technical, analytical, and evaluative and follow-through skills in... 
    Traineeship
    Summer internship

    Research-Foundation-Cun

    New York, NY
    3 days ago
  • The Consulting Solutions seeks a Marketing Scientist to support advertising measurement and media performance in New York or San Francisco. This role requires over 10 years of deep expertise in advertising measurement, including incrementality testing and attribution.... 

    The Consulting Solutions

    New York, NY
    3 days ago
  • OpenAI is looking for a Marketing Scientist to enhance media performance for its Ads function. This New York or San Francisco-based role focuses on applying advanced measurement methods in collaboration with sales, partners, and clients. The ideal candidate will possess... 

    OpenAI

    New York, NY
    1 day ago
  • $40 per hour

    A data annotation company seeks an R&D Biologist to enhance AI models by evaluating chatbot outputs related to complex biology queries. This remote position allows flexibility in project selection and scheduling, with hourly rates starting at $40+ USD. Ideal candidates... 
    Hourly pay
    Remote work

    DataAnnotation

    New York, NY
    3 days ago
  • $40 per hour

     ...cybersecurity solutions provider is looking for experienced professionals to join their team and help train AI models. The role involves evaluating AI-generated security content and providing technical problem-solving to enhance AI systems. Candidates should have over 2 years... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  •  ...engineering and product teams to deploy, evaluate, and iterate on learning systems in...  ...teams and backgrounds. As a Senior AI Research Scientist for Perception for Contact Rich Manipulation...  ...robust evaluation frameworks to measure and improve agent performance. Collaborate... 
    Remote work

    AI Chopping Block, Inc.

    New York, NY
    15 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Scientist (Measurement and Evaluation). Be the first to apply!