Research Scientist (Measurement and Evaluation)
aijoblist
About Abridge Abridge was founded in 2018 with the mission of powering deeper understanding in healthcare. Our AI-powered platform was purpose-built for medical conversations, improving clinical documentation efficiencies while enabling clinicians to focus on what matters most—their patients. Our enterprise-grade technology transforms patient-clinician conversations into structured clinical notes in real-time, with deep EMR integrations. Powered by Linked Evidence and our purpose-built, auditable AI, we are the only company that maps AI-generated summaries to ground truth, helping providers quickly trust and verify the output. As pioneers in generative AI for healthcare, we are setting the industry standards for the responsible deployment of AI across health systems. We are a growing team of practicing MDs, AI scientists, PhDs, creatives, technologists, and engineers working together to empower people and make care make more sense. We have offices located in the Mission District in San Francisco, the SoHo neighborhood of New York, and East Liberty in Pittsburgh. The Role Abridge is hiring Research Scientists to join our Strategic Research team to rigorously evaluate and advance the real-world impact of ambient AI on patient outcomes, care quality, and provider experience. In this role, you will design and lead empirical studies of Abridge models and products in partnership with health systems, leveraging large-scale clinical conversation data to generate new insights about care delivery, documentation quality, clinical decision-making, and downstream patient outcomes. You will operationalize complex constructs—such as quality of care, safety, cognitive burden, and return on investment—using principled measurement frameworks and rigorous experimental or quasi-experimental methods. Working closely with our science and product teams, you will also develop evaluation frameworks that inform model development and product strategy. Your work will contribute to broader scientific understanding of how AI systems affect patients and providers in the real world. This role sits at the intersection of methodological innovation and practical impact, applying serious measurement science to systems that directly shape patient care. About Strategic Research : The Strategic Research team at Abridge has two primary functions: (i) designing and conducting rigorous research studies investigating the impact of ambient AI as an intervention in partnership with collaborating health systems; and (ii) supporting external research efforts that leverage Abridge data. In addition to driving and supporting empirical studies of the impact of ambient AI-enabled technologies, the team works closely with our science and engineering teams on core model evaluation. The common thread to all our work is ensuring that every partner-facing research initiative meets the highest standards of rigour, credibility, and strategic value. What You’ll Do Design and conduct evaluations of Abridge models and products Engage with external researchers and other stakeholders on designing and conducting research on ambient AI and research that leverages Abridge data Develop a strong user-centric and patient-centric mindset, grounding the research in empathy for the real world experience of providers and patients Collaborate across our cross-functional product teams to ensure the research is deeply informed by current practices and our product roadmap Write technical reports and give presentations to internal and external stakeholders Actively contribute to the wider research community by publishing original research in leading peer-reviewed publication venues Mentor research interns What You’ll Bring PhD in statistics, biostatistics, computer science, economics, information systems, clinical informatics, or a related field. Expertise in rigorous quantitative or mixed-methods approaches for conducting evaluations using observational and experimental data. Strong research track record in evaluation and measurement, as evidenced by high-impact publications at peer-reviewed journals or conferences. A problem-before-method mindset. You do not change the question to make it amenable to simple analysis, but instead push the methodological frontier to solve the real world problems that matter to health systems, providers, and patients. A curious, adaptable, and proactive mindset, with a desire to learn and grow as a researcher in a fast-paced startup environment. Passion for and understanding of Abridge’s mission. Must be willing to work from our New York City office at least 3x per week. This position requires a commitment to a hybrid work model, with the expectation of coming into the office a minimum of (3) three times per week. Relocation assistance is available for candidates willing to move to New York City. We value people who want to learn new things, and we know that great team members might not perfectly match a job description. If you’re interested in the role but aren’t sure whether or not you’re a good fit, we’d still like to hear from you. Why Work at Abridge? At Abridge, we’re transforming healthcare delivery experiences with generative AI, enabling clinicians and patients to connect in deeper, more meaningful ways. Our mission is clear: to power deeper understanding in healthcare. We’re driving real, lasting change, with millions of medical conversations processed each month. Joining Abridge means stepping into a fast-paced, high-growth startup where your contributions truly make a difference. Our culture requires extreme ownership—every employee has the ability to (and is expected to) make an impact on our customers and our business. Beyond individual impact, you will have the opportunity to work alongside a team of curious, high-achieving people in a supportive environment where success is shared, growth is constant, and feedback fuels progress. At Abridge, it’s not just what we do—it’s how we do it. Every decision is rooted in empathy, always prioritizing the needs of clinicians and patients. We’re committed to supporting your growth, both professionally and personally. Whether it's flexible work hours, an inclusive culture, or ongoing learning opportunities, we are here to help you thrive and do the best work of your life. If you are ready to make a meaningful impact alongside passionate people who care deeply about what they do, Abridge is the place for you. How we take care of Abridgers: Generous Time Off : 14 paid holidays, flexible PTO for salaried employees, and accrued time off for hourly employees Comprehensive Health Plans : Medical, Dental, and Vision coverage for all full-time employees and their families. Generous HSA Contribution : If you choose a High Deductible Health Plan, Abridge makes monthly contributions to your HSA. Paid Parental Leave : Generous paid parental leave for all full-time employees. Family Forming Benefits: Resources and financial support to help you build your family. 401(k) Matching : Contribution matching to help invest in your future. Personal Device Allowance : Tax free funds for personal device usage. Pre-tax Benefits: Access to Flexible Spending Accounts (FSA) and Commuter Benefits. Lifestyle Wallet : Monthly contributions for fitness, professional development, coworking, and more. Mental Health Support : Dedicated access to therapy and coaching to help you reach your goals. Sabbatical Leave : Paid Sabbatical Leave after 5 years of employment. Compensation and Equity : Competitive compensation and equity grants for full time employees. ... and much more! Equal Opportunity Employer Abridge is an equal opportunity employer and considers all qualified applicants equally without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, or disability. Staying safe - Protect yourself from recruitment fraud We are aware of individuals and entities fraudulently representing themselves as Abridge recruiters and/or hiring managers. Abridge will never ask for financial information or payment, or for personal information such as bank account number or social security number during the job application or interview process. Any emails from the Abridge recruiting team will come from an @abridge.com email address. You can learn more about how to protect yourself from these types of fraud by referring to this article. Please exercise caution and cease communications if something feels suspicious about your interactions. #J-18808-Ljbffr aijoblist
- A health tech company in New York City is hiring a Research Scientist to evaluate the impact of ambient AI on healthcare outcomes. The role emphasizes designing studies, engaging with health systems, and fostering collaboration across product teams. A PhD in a relevant...SuggestedWork at office
$216k - $270k
...Scale Labs, Research Scientist - Frontier Risk Evaluations As the leading data and evaluation partner for frontier AI companies, Scale plays an integral... ...Evaluations, you will design and create evaluation measures, harnesses and datasets for measuring the risks posed...SuggestedFull time$70 - $100 per hour
...Mercor is seeking Expert Professionals for STEM Research to guide research teams and design rigorous domain tasks. Candidates should... ...requires a 40-hour work commitment during weekdays and involves the evaluation of AI agents within scientific contexts. Strong written...SuggestedHourly payContract workRemote workWeekday work- ...Wizard, Inc. is seeking an Applied Scientist in the United States to measure and enhance the accuracy of its AI Shopping Agent. You will lead in defining... ...Engineering. Ideal candidates will have experience in evaluating AI systems and be adept at navigating ambiguity. #J-18...SuggestedRemote work
$40 per hour
...We are looking for a Theoretical Physicist to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role you will need to hold an expert understanding...SuggestedHourly payFull timeContract workPart timeRemote work$30 - $50 per hour
...A tech company specializing in AI research is seeking a mid-senior level researcher to manage applied AI research projects. The role involves end-to-end research cycles, building and evaluating LLM systems, and collaborating on dataset development. The ideal candidate...Hourly payFull timeRemote work$30 - $50 per hour
...A tech company is seeking an AI Researcher to support end-to-end research for modern AI systems. This remote role involves designing experiments, defining evaluation protocols, and improving evaluation rigor for large language models. Key responsibilities include developing...Hourly payRemote work$40 per hour
...A leading data services company in Pennsylvania is seeking a Research And Development Chemist to join their team. The successful candidate will evaluate AI chatbots by measuring their outputs against complex chemistry questions. The role offers flexibility in project...Hourly payContract workRemote work- Senior Clinical Quality Measure Scientist To support our mission, the Health Research and Analytics (HRA) business line is currently seeking a Senior Clinical Quality... ...leads multidisciplinary teams responsible for evaluating measure importance, scientific acceptability (...Work at officeLocal areaRemote workFlexible hours
- ...supported and seen. About the Role We are looking for a Data Scientist, Growth & Measurement to help build the analytical foundation that guides how... ...partners and internal stakeholders Design and evaluate geo tests, holdouts, lift studies, and quasi-experimental...Temporary workRemote work
$140k - $300k
...AI that ships, scales, and measurably improves how healthcare works... ...toward the RS/RE blend - applied scientists who feel comfortable getting... .... You’ll conduct applied research on real healthcare data,... ...running large-scale training and evaluation on distributed...Work at officeLocal areaFlexible hours3 days per week- Crossing Hurdles is seeking candidates for a STEM India position focused on supporting AI model development. This remote role requires advanced knowledge in Mathematics, Physics, Chemistry, or Biology, and candidates should either be 4th or 5th year PhD students or PhD...Contract workRemote work
$40 per hour
...We are looking for a Research Scientist (Biology) to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role you will need to hold an expert level...Hourly payFull timeContract workPart timeRemote work- ...Achira Join a world-class team of researchers, scientists, and engineers unifying probabilistic... ...large datasets, and high-throughput evaluation on an ML-framework-native... ...biomolecular conformational landscapes, driving measurable gains in efficiency for small...
- ...the Role We're looking for an applied research scientist to join our small, high-leverage... ...production infrastructure, and build the evaluation frameworks needed to trust and ship those... ...or MarTech Experience with marketing measurement (attribution, incrementality,...Work at office3 days per week
$40 per hour
...cybersecurity solutions provider is looking for experienced professionals to join their team and help train AI models. The role involves evaluating AI-generated security content and providing technical problem-solving to enhance AI systems. Candidates should have over 2 years...Hourly payRemote workFlexible hours$40 per hour
...A leading AI training company is looking for a Research Scientist (Biology) to evaluate AI models. This role involves testing chatbots with complex biology questions and requires strong expertise in biology and related fields. Candidates must be fluent in English and...Hourly payContract workRemote workFlexible hours$40 per hour
...A leading AI systems firm is seeking experienced quantitative professionals to evaluate AI-generated quantitative work and contribute to cutting-edge AI projects. Position offers a fully remote work environment with flexible scheduling and competitive pay, starting at...Hourly payRemote workFlexible hours$175.1k - $236.9k
...lead the Ads industry and redefine how we measure the effectiveness of Amazon Ads business... ...science bar by connecting leading-edge research to Amazon‑scale implementation? If so,... ...interactions. You will work with Applied Scientists, Economists, and Data Scientists on a dedicated...Flexible hours$40 per hour
...A technology firm specializing in AI is looking for a Research Scientist (Chemistry) to join their team. This role involves training AI models by evaluating chatbot outputs on complex chemistry questions. The candidate should possess a solid understanding of chemistry...Hourly payContract workRemote work- ...A technology company is seeking a Research Scientist (Chemistry) to enhance AI models. The role requires evaluating chatbot outputs on complex chemistry queries and ensuring the quality of AI models. Ideal candidates should have a solid grasp of chemistry concepts and...Hourly payRemote work
$30 - $50 per hour
...AI Research Jobs in the United States (Remote, Full-Time) You will run applied AI research projects for US-based customers... ....zone, translating open-ended research questions into measurable experiments across LLM evaluation, RLHF data design, prompt evaluation, and model...Hourly payFull timeRemote work$155k - $165k
...Pearson is seeking a Lead Specialist, Psychometrician, to apply advanced psychometric methodologies and lead research in educational measurement. Candidates should possess a doctoral degree in educational measurement and over eight years of experience in operational assessment...$40 per hour
...A dynamic AI company is seeking an R&D Physicist to join their team. In this role, you will evaluate AI chatbots by providing complex physics questions and assess their outputs for correctness and performance. A strong understanding of classical mechanics, electromagnetic...Hourly payRemote work$50 - $60 per hour
...A leading research initiative is seeking PhD holders or outstanding Master's graduates in physics for a part-time role. You will evaluate and advance large language models by applying your expertise in physics. This remote position requires strong analytical abilities...Part timeRemote workFlexible hours$40 per hour
...A technology company is seeking a Scientific Researcher (Physics) to train AI models by solving complex physics problems and evaluating their outputs. Candidates should have a strong understanding of classical mechanics and related physics concepts. The position offers...Hourly payRemote workFlexible hours- ...Mercor is seeking Part-time Chemistry Researchers to connect elite talent with leading AI labs. The role involves authoring challenging chemistry problems, evaluating model outputs, and identifying failures. Ideal candidates will have significant publications in top...Hourly payPart timeRemote work
- A leading data services company is seeking an Applied Mathematician to evaluate AI models by providing complex mathematical problems to chatbots and assessing their outputs for quality and performance. This role offers flexibility with fully remote work and allows you...Hourly payRemote work
$398.4k
...Manager, Machine Learning Research Scientist, GenAI San Francisco, CA; Seattle, WA; New York... ...is building the foundational research, evaluation methodologies, and agent/RL... ...shape how next-generation AI is built, measured, and deployed. As a Research Scientist...Full time$175k - $275k
...Product (Captions by Mirage) Research (Seeing Voices, technical-... ...is seeking a Research Scientist to advance the frontier of multimodal... ..., loss functions, and evaluation methods optimizing for highly... ...Translate research insights into measurable product improvements What...Full timeLocal areaNight shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Scientist (Measurement and Evaluation). Be the first to apply!
- principal applied scientist New York, NY
- image scientist New York, NY
- scientist New York, NY
- research scientist machine learning deep learning New York, NY
- deep learning scientist New York, NY
- senior principal scientist New York, NY
- machine learning scientist New York, NY
- bioanalytical scientist New York, NY
- scientist immunology New York, NY
- safety scientist New York, NY


