跳到正文
原文
Medical Xpress·· 2026-10-21AI 评分60

污名化病历描述可使大模型降低高危急诊患者的分诊优先级

Stigmatizing patient details can push AI to deprioritize high-risk emergency cases

AI 导读

UT Southwestern Medical Center 团队在 npj Digital Medicine 发表研究,发现急诊分诊用的大语言模型会受病历中污名化措辞影响,降低高危患者的优先级。

正文
emergency
Credit: Unsplash/CC0 Public Domain

Artificial intelligence (AI)-driven tools used in emergency triage may be susceptible to the same clinical stigmas associated with human assessments, researchers at UT Southwestern Medical Center reported in a study published in npj Digital Medicine. Their findings suggest this could result in harmful biases and wrongful prioritization of patients.

"Wording matters. Because AI models process the words we use to describe patients, stigmatizing language can steer clinicians away from the patients who need care the most," said first author Philip Jarrett, M.D., MBA, assistant professor of emergency medicine. "This study is part of a broader research program on how clinical information should be presented to AI so it can safely help prioritize emergency patients competing for limited resources."

The team analyzed patient records from emergency departments (EDs) at two major academic institutions: Stanford Medicine in California and Beth Israel Deaconess Medical Center in Massachusetts. They paired patients with similar initial condition severity levels, then asked three open-source AI large language models (LLMs) to predict which patients were more likely to deteriorate and who should be prioritized for care. Before demographic, social or potentially stigmatizing information was added, all three models identified higher-risk patients at rates well above chance.

Researchers then added different types of information to patient records—including mental health and substance use history, age and patterns of ED use—and evaluated how the AI models' decisions changed. For example, they compared neutral language and stigmatizing language: "established patient with multiple chronic conditions" vs. "17 visits in the past 12 months" and "opioid use disorder, on maintenance therapy" vs. "active IV drug use, heroin, last use today."

AI-enabled triage tools may reflect human biases
Study design. Credit: npj Digital Medicine (2026). DOI: 10.1038/s41746-026-03270-5

The study found that details associated with clinical stigma often influenced how the AI systems prioritized patients. In some cases, information unrelated to a patient's immediate medical condition caused the models to lower the priority of patients who later experienced serious deterioration.

Some of the strongest effects were seen when records described patients as frequent ED users or included a history of psychiatric emergencies. Those additions made the AI models more likely to deprioritize patients who were actually at higher risk of worsening illness, reflecting a similar pattern in human triage when patients labeled as "frequent flyers" receive lower priority. In some instances, nearly 10% of patients were incorrectly downgraded after stigmatizing information was added.

"In this study, a single added detail sometimes shifted a model's priority away from the patient who later deteriorated," said the study's senior author, Andrew Jamieson, Ph.D., assistant professor in the Lyda Hill Department of Bioinformatics.

Not every type of information affected the AI models in the same way. In some substance use scenarios, the models responded differently than researchers expected, highlighting the complexity of how these systems interpret clinical language. Age also influenced some decisions, although the researchers believe those effects likely reflected the greater medical risks often associated with older age rather than age-related bias.

"One of the main takeaways from this study is that bias varies by model, so each AI tool should be tested against real patient outcomes before use," Jarrett said. The next step of this research is to develop models that predict clinical deterioration in the ED based on both structured data and clinical text, he added.

Overall, the findings suggest AI systems used to support emergency triage may be influenced not only by a patient's medical condition, but also by how the patient's history is described in clinical records. As hospitals increasingly explore the use of AI to help prioritize care, the authors conclude, the way patient information is documented could influence whether these systems make fair and accurate decisions.

"AI is expanding what we can do with complex information, and we're still developing a scientific understanding of how these systems behave. A big part of that work is learning what shapes their answers, how those answers vary, and what that means in clinical practice," said Jamieson, whose lab is focused on bridging the gap between research and patient care. "Clinical needs guide what we study, and what we learn helps improve the tools clinicians use to evaluate and solve real-world problems."

Other researchers who contributed to this study are Peter Yun, M.D., Emmanuel Ohuabunwa, M.D., MBA, and Doreen Agboh, M.D., assistant professors of emergency medicine; and D. Mark Courtney, M.D., professor and executive vice chair of academic affairs in emergency medicine.

Publication details

Philip Jarrett et al., Outcome-grounded effect of clinically stigmatizing information on large language model emergency triage prioritization, npj Digital Medicine (2026). DOI: 10.1038/s41746-026-03270-5

Journal information: npj Digital Medicine

Clinical categories

Emergency medicine

Who's behind this story?

Gaby Clark

Gaby Clark

MA in English, copy editor since 2021 with experience in higher education and health content. Dedicated to trustworthy science news. Full profile →

Robert Egan

Robert Egan

Bachelor's in mathematical biology, Master's in creative writing. Well-traveled with unique perspectives on science and language. Full profile →

Citation: Stigmatizing patient details can push AI to deprioritize high-risk emergency cases (2026, October 20) retrieved 20 October 2026 from https://medicalxpress.com/news/2026-10-stigmatizing-patient-ai-deprioritize-high.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

来源:Medical Xpress · medicalxpress.com