Research Scientist (Measurement and Evaluation)
Abridge
About Abridge Abridge was founded in 2018 with the mission of powering deeper understanding in healthcare. Our AI-powered platform was purpose-built for medical conversations, improving clinical documentation efficiencies while enabling clinicians to focus on what matters most—their patients. Our enterprise-grade technology transforms patient-clinician conversations into structured clinical notes in real-time, with deep EMR integrations. Powered by Linked Evidence and our purpose-built, auditable AI, we are the only company that maps AI-generated summaries to ground truth, helping providers quickly trust and verify the output. As pioneers in generative AI for healthcare, we are setting the industry standards for the responsible deployment of AI across health systems. We are a growing team of practicing MDs, AI scientists, PhDs, creatives, technologists, and engineers working together to empower people and make care make more sense. We have offices located in the Mission District in San Francisco, the SoHo neighborhood of New York, and East Liberty in Pittsburgh. The Role Abridge is hiring Research Scientists to join our Strategic Research team to rigorously evaluate and advance the real-world impact of ambient AI on patient outcomes, care quality, and provider experience. In this role, you will design and lead empirical studies of Abridge models and products in partnership with health systems, leveraging large-scale clinical conversation data to generate new insights about care delivery, documentation quality, clinical decision-making, and downstream patient outcomes. You will operationalize complex constructs—such as quality of care, safety, cognitive burden, and return on investment—using principled measurement frameworks and rigorous experimental or quasi-experimental methods. Working closely with our science and product teams, you will also develop evaluation frameworks that inform model development and product strategy. Your work will contribute to broader scientific understanding of how AI systems affect patients and providers in the real world. This role sits at the intersection of methodological innovation and practical impact, applying serious measurement science to systems that directly shape patient care. About Strategic Research : The Strategic Research team at Abridge has two primary functions: (i) designing and conducting rigorous research studies investigating the impact of ambient AI as an intervention in partnership with collaborating health systems; and (ii) supporting external research efforts that leverage Abridge data. In addition to driving and supporting empirical studies of the impact of ambient AI-enabled technologies, the team works closely with our science and engineering teams on core model evaluation. The common thread to all our work is ensuring that every partner-facing research initiative meets the highest standards of rigour, credibility, and strategic value. What You’ll Do Design and conduct evaluations of Abridge models and products Engage with external researchers and other stakeholders on designing and conducting research on ambient AI and research that leverages Abridge data Develop a strong user-centric and patient-centric mindset, grounding the research in empathy for the real world experience of providers and patients Collaborate across our cross-functional product teams to ensure the research is deeply informed by current practices and our product roadmap Write technical reports and give presentations to internal and external stakeholders Actively contribute to the wider research community by publishing original research in leading peer-reviewed publication venues Mentor research interns What You’ll Bring PhD in statistics, biostatistics, computer science, economics, information systems, clinical informatics, or a related field. Expertise in rigorous quantitative or mixed-methods approaches for conducting evaluations using observational and experimental data. Strong research track record in evaluation and measurement, as evidenced by high-impact publications at peer-reviewed journals or conferences. A problem-before-method mindset. You do not change the question to make it amenable to simple analysis, but instead push the methodological frontier to solve the real world problems that matter to health systems, providers, and patients. A curious, adaptable, and proactive mindset, with a desire to learn and grow as a researcher in a fast-paced startup environment. Passion for and understanding of Abridge’s mission. Must be willing to work from our New York City office at least 3x per week. This position requires a commitment to a hybrid work model, with the expectation of coming into the office a minimum of (3) three times per week. Relocation assistance is available for candidates willing to move to New York City. We value people who want to learn new things, and we know that great team members might not perfectly match a job description. If you’re interested in the role but aren’t sure whether or not you’re a good fit, we’d still like to hear from you. Why Work at Abridge? At Abridge, we’re transforming healthcare delivery experiences with generative AI, enabling clinicians and patients to connect in deeper, more meaningful ways. Our mission is clear: to power deeper understanding in healthcare. We’re driving real, lasting change, with millions of medical conversations processed each month. Joining Abridge means stepping into a fast-paced, high-growth startup where your contributions truly make a difference. Our culture requires extreme ownership—every employee has the ability to (and is expected to) make an impact on our customers and our business. Beyond individual impact, you will have the opportunity to work alongside a team of curious, high-achieving people in a supportive environment where success is shared, growth is constant, and feedback fuels progress. At Abridge, it’s not just what we do—it’s how we do it. Every decision is rooted in empathy, always prioritizing the needs of clinicians and patients. We’re committed to supporting your growth, both professionally and personally. Whether it's flexible work hours, an inclusive culture, or ongoing learning opportunities, we are here to help you thrive and do the best work of your life. If you are ready to make a meaningful impact alongside passionate people who care deeply about what they do, Abridge is the place for you. How we take care of Abridgers: Generous Time Off : 14 paid holidays, flexible PTO for salaried employees, and accrued time off for hourly employees Comprehensive Health Plans : Medical, Dental, and Vision coverage for all full-time employees and their families. Generous HSA Contribution : If you choose a High Deductible Health Plan, Abridge makes monthly contributions to your HSA. Paid Parental Leave : Generous paid parental leave for all full-time employees. Family Forming Benefits: Resources and financial support to help you build your family. 401(k) Matching : Contribution matching to help invest in your future. Personal Device Allowance : Tax free funds for personal device usage. Pre-tax Benefits: Access to Flexible Spending Accounts (FSA) and Commuter Benefits. Lifestyle Wallet : Monthly contributions for fitness, professional development, coworking, and more. Mental Health Support : Dedicated access to therapy and coaching to help you reach your goals. Sabbatical Leave : Paid Sabbatical Leave after 5 years of employment. Compensation and Equity : Competitive compensation and equity grants for full time employees. ... and much more! Equal Opportunity Employer Abridge is an equal opportunity employer and considers all qualified applicants equally without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, or disability. Staying safe - Protect yourself from recruitment fraud We are aware of individuals and entities fraudulently representing themselves as Abridge recruiters and/or hiring managers. Abridge will never ask for financial information or payment, or for personal information such as bank account number or social security number during the job application or interview process. Any emails from the Abridge recruiting team will come from an @abridge.com email address. You can learn more about how to protect yourself from these types of fraud by referring to this article. Please exercise caution and cease communications if something feels suspicious about your interactions. #J-18808-Ljbffr Abridge
$216k - $270k
SCALE LABS, RESEARCH SCIENTIST — FRONTIER RISK EVALUATIONS As the leading data and evaluation partner for frontier AI companies, Scale plays an integral... ...Evaluations, you will design and create evaluation measures, harnesses and datasets for measuring the risks...SuggestedFull time- Senior Clinical Quality Measure Scientist To support our mission, the Health Research and Analytics (HRA) business line is currently seeking a Senior Clinical Quality... ...leads multidisciplinary teams responsible for evaluating measure importance, scientific acceptability (...SuggestedWork at officeLocal areaRemote workFlexible hours
$40 per hour
...A leading AI systems firm is seeking experienced quantitative professionals to evaluate AI-generated quantitative work and contribute to cutting-edge AI projects. Position offers a fully remote work environment with flexible scheduling and competitive pay, starting at...SuggestedHourly payRemote workFlexible hours$50 - $100 per hour
...our growing group of expert biologists helping us improve and evaluate our AI tools! Benchmarking and training our tools is integral... ...training datasets, and are looking to grow our pool of expert researchers in various domains of biology. Responsibilities Annotating or...SuggestedHourly payFull timeContract workPart time$175k - $275k
...Product (Captions by Mirage) Research (Seeing Voices, technical-... ...is seeking a Research Scientist to advance the frontier of multimodal... ..., loss functions, and evaluation methods optimizing for highly... ...Translate research insights into measurable product improvements What...SuggestedFull timeLocal areaNight shift$238k - $302k
...in simulation across 15+ U.S. states. Rigorous behavioral evaluation of the Waymo Driver is a critical part of scaling our ride hailing... ...goals. In this role, you will lead key initiatives for measuring the quality and trustworthiness of the behavior evaluation portfolio...Full timeRemote work$264.8k - $331k
...As the leading data and evaluation partner for frontier AI companies... ...generation of AI capabilities. Our Research teams work with the industry'... ...Machine Learning Research Scientist on the LLM Evals team, you... ..., metrics, and benchmarks to measure the capabilities and limitations...Full time$50 - $60 per hour
...We are looking for a Legal Researcher to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role you will need to hold an expert level of legal reasoning...Hourly payContract work- ...Basis Basis is a nonprofit applied AI research organization with two mutually reinforcing... ...values first. About the Role Research scientists lead Basis’ efforts to develop a deeper... ...to use your materials for both hiring evaluation and recruitment-related research and...Full timeWork at officeImmediate start
- ...Zillow is looking for a Principal Data Scientist to steer the measurement strategy for its Elevate advertising platform. In this remote role, you will utilize your deep technical expertise and business judgment to lead incrementality, lift testing, and shape the data-...Remote work
- Job Purpose The Scientist II embraces our safety-driven culture in all tasks and demonstrates... ...analysis procedures to quantitatively measure compounds in a variety of formulations... ...product blends as guided. Collects and evaluates data, utilizing lab notebooks and laboratory...Temporary workWork at officeFlexible hours
$190k - $210k
...We are seeking a Principal Applied Scientist to lead the research, development, and deployment of advanced... ..., real‑world deployment, and measurable business impact . You will architect... ...customer and client outcomes. Research and evaluate emerging AI technologies, foundation...Temporary workFlexible hours- ...backed by top VCs including Y Combinator. As a Generative AI Research Scientist, you'll work alongside our founders and team members to... ...scaling, pre-training and fine-tuning strategies, and rigorous evaluation methods. Your work will span various advanced generative...
$197.3k - $313.7k
...Position Overview: As a Decision Scientist within the Data & Analytics... ...cross-functional teams to measure agentic impact, influence... ...Responsibilities Agentic Evaluation Frameworks: Develop and scale... ...Computer Science, Operations Research, or similar field. Experience...- ...Achira Join a world-class, interdisciplinary team of ML researchers, physicists, chemists, and engineers reimagining atomistic... ...research end-to-end - from concept and architecture to training, evaluation, and deployment. Thrive in a culture that rewards rigor,...
$252k - $315k
...high quality data and accelerate progress in GenAI research. We are looking for Research Scientists and Research Engineers with expertise in LLM post-training... ...role. This allows us to ensure a fair and thorough evaluation of all applicants. About Us: At Scale, our mission...Full time$169.16k - $241.65k
...of listeners discover what they love. Within this space, our research team focuses on advancing the state of the art in machine learning... ...and generative AI Develop novel methodologies, models, and evaluation frameworks to advance personalization systems Design and execute...Work from homeFlexible hours$180k - $300k
..., when Snorkel started as a research project in the Stanford AI Lab... ...organizations to empower scientists, engineers, financial experts... ...environments and tasks, developing evaluation frameworks, probing model... ...rubrics that establish measurable project success metrics Develop...Local area$200k - $245k
...are seeking an exceptional Senior Applied Scientist to build the algorithmic systems that... ...Garner. These systems determine how we evaluate providers, make recommendations, and optimize... ...problems into systems that deliver measurable impact, defining the objective functions...Work at officeWork visaFlexible hours3 days per week- ...ensuring high standards in the planning /optimization, delivery and evaluation of radiation therapy and in this capacity is responsible for... ...acceptance testing upon completed installation, and measuring performance parameters to ensure the accurate clinical implementation...Work at officeLocal area
$137k - $167k
...Innovations Program. The Health Economist conducts policy-related research and evaluation studies focused on domestic health care programs,... ...aging and long-term care; health plan performance and quality measurement; telehealth; and health information technology. The Senior...Full timeFixed term contractH1bWork at officeRemote work$145k - $165k
...engaging, but instructionally effective , measurable and scalable . The Senior Learning... ...logic Experience using data to evaluate and improve learning effectiveness Strong... ...@grp.pearson.com. Job: Research, Efficacy, and Psychometrics Job Family...Full timeTemporary workRemote work$120k - $150k
...our clients A client of AlphaStaffHCM™ is searching for a Research Scientist who will work on the modelling, simulation, and architectural... ...Perform rigorous electromagnetic and Multiphysics simulations to evaluate optical, nonlinear, and quantum effects. Model and simulate...Work at officeLocal area$60 per hour
...A dynamic AI development company is seeking quantitative professionals to evaluate AI-generated analyses and contribute to advanced AI systems. This role requires a minimum of 2 years of experience in fields such as data science or statistics, along with coding skills...Hourly payRemote work$60 per hour
...A technology company is seeking quantitative professionals to evaluate AI-generated analytical work and contribute to the development of AI systems. This role offers fully remote work flexibility and competitive pay up to $60 per hour. Candidates should have 2+ years...Hourly payRemote workFlexible hours$40 per hour
...technology firm in the United States is looking for a Quantitative Analyst to join their team. This role involves training AI models and evaluating their performance. Candidates should possess expert mathematical reasoning skills and can work on a flexible schedule in a remote...Hourly payRemote workFlexible hours$140.8k - $176k
...and retention. As an Applied Scientist specializing in Machine Learning and Operations Research on this team, you will develop... ...and existing problems. Evaluate machine learning systems against... ...metrics and development measurement methodologies to monitor the health...Hourly payFull timeTemporary workWork at officeLocal area3 days per week$95.6k - $148.4k
...specific audiences and objectives. Conduct research and analysis on economic topics,... ...committed to a merit-based hiring process, evaluating all candidates consistently using... ...relevant experience, demonstrated skills, measurable impact, and alignment with the role's...Local areaWorldwide$85k - $150k
...and computational neuroscience. We're seeking a full time Research Scientist, Artificial Intelligence (PhD) to join our growing team of... ...research, from conceptual design to reproducible experiments and evaluation. Strong mathematical foundations in linear algebra,...Full time$100 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...including detailed problem statements, golden solutions, and evaluation criteria. Evaluate the model's performance on tasks to...Contract workPart timeSummer workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Scientist (Measurement and Evaluation). Be the first to apply!
- downstream processing scientist New York, NY
- machine learning research scientist New York, NY
- drug safety scientist New York, NY
- remote scientist New York, NY
- variant scientist New York, NY
- hplc scientist New York, NY
- graduate scientist New York, NY
- operations research scientist New York, NY
- senior scientist New York, NY
- research associate scientist New York, NY


