跳到正文
原文
Medical Xpress·· 2026-10-09精选AI 评分65

患者面AI在初级保健的真实世界安全性与质量研究发表在柳叶刀

First real-world study of safety and quality of patient-facing AI in primary care

AI 导读

Beth Israel Deaconess Medical Center 与 Google 合作开展的前瞻性真实世界可行性研究评估了 Articulate Medical Intelligence Explorer(AMIE)这一患者面对话式 AI 系统的安全性。

推荐理由

原文报告真实世界患者面AI的安全性与可用性初步结果,可为同类技术临床部署提供安全基线参考。

正文 · 原文
medicine and ai
Credit: Pixabay/CC0 Public Domain

The aging population, workforce changes and patients' increasingly complex medical needs are all factors straining primary care systems around the world. Artificial intelligence tools have emerged as a potential means of extending the capabilities of health care workers, including in primary care settings. Large language models (LLMs), also known as chatbots, have performed extremely well in simulations. However, little is known about how these systems perform with real patients.

Researchers at Beth Israel Deaconess Medical Center (BIDMC) have conducted what they believe is the first prospective real-world study of a patient-facing conversational AI system in primary care, taking an important step toward evaluating the technology through the same kind of rigorous clinical testing used for other health care interventions. The findings are published in The Lancet.

"Despite the theoretical performance of patient-facing AI in experimental settings, it is unclear how conversationally safe these encounters are in a real-world setting," said Adam Rodman, M.D., director of AI programs at the Carl J. Shapiro Institute for Research and Education at BIDMC. "Before we begin evaluating them as workload interventions, AI tools must first be shown to operate safely and acceptably in real care workflows. With this research, we set out to assess whether this kind of technology could improve both patient and physician experience."

Testing AI with real-time physician oversight

Rodman and colleagues, in collaboration with researchers at Google, evaluated the Articulate Medical Intelligence Explorer (AMIE), a medical AI chatbot that patients used from home after scheduling an urgent primary care appointment with a BIDMC physician. Through a secure text-chat interface, the system asked patients about their symptoms, gathered medical histories, provided possible diagnoses for patients to review with their doctor and generated a summary for clinician review before the visit.

Conducted between April and November 2025, the study enrolled 114 patients, 98 of whom completed both the AI interaction and their primary care appointment. Every conversation was monitored in real time by a board-certified internal medicine physician who could intervene if a patient appeared at risk of harm, experienced significant emotional distress or asked to end the session, or if the physician identified a potential safety concern—such as the need to clarify symptoms, provide emergency care instructions or address concern about a serious possible diagnosis.

Across all 98 completed encounters, none of the conversations required a safety-stop intervention. Supervising physicians identified one hallucination and provided additional clinical clarification in five cases.

"This study helps establish the baseline characteristics of such real-world conversations," said co-first author Peter Brodeur, M.D., a clinical fellow in cardiovascular medicine at BIDMC. "These baseline characteristics provide a foundation for all future prospective trials aimed at discovering when human-on-the-loop workflows may be appropriate."

Positive patient ratings, lingering trust concerns

Patients appeared receptive to the technology. Patients rated the quality of AMIE's conversations favorably—as did physician evaluators—across most measures. Moreover, patient attitudes toward AI improved after interacting with the chatbot and remained elevated following their appointment with a clinician.

"One of the most important questions was simply how patients would engage with a conversational AI system in a real clinical setting," said co-first author Jacob Koshy, M.D., M.P.H., a hospitalist in the Division of General Medicine at BIDMC. "By prospectively observing these interactions, we were able to better understand both the opportunities and the limitations of the technology in the context of routine patient care."

While patients gave high marks to the system's ability to listen, explain information and help them feel at ease, concerns remained in two areas: trust in the confidentiality of information shared with the system and trust in the chatbot's honesty and trustworthiness. Researchers said those findings underscore the importance of continued work to build patient trust as AI tools move into clinical care.

"Research suggests that patient trust in medical AI systems flows from relationships with their human providers," said Rodman. "Future research will need to explore which interaction characteristics can build patient trust and how AI interactions can enhance the patient-physician relationship."

Visit preparation benefits, health outcomes untested

The findings also suggest the technology may have practical value in clinical workflows.

Primary care providers were able to review an AI-generated transcript or summary before seeing their patients in 44 cases. In 75% of cases, physicians said doing so helped them prepare for the visit, and in 57% of cases, they reported it may have influenced their clinical approach. In only one case did a provider report the interaction as somewhat harmful, citing concern that a patient may have experienced anxiety after AMIE included lymphoma among its possible diagnoses.

Rodman and colleagues emphasized that the study was designed to evaluate feasibility rather than to determine whether AI improves health outcomes.

"Our primary care practice—and our hospital—has a long history of rigorously monitoring the safety of the clinical care we provide, and this study serves as an exemplar of how the safety of AI may be assessed prior to clinical implementation," said co-senior author Marc L. Cohen, M.D., clinical chief of primary care in the Division of General Medicine at BIDMC. "We believe the future involves continued involvement of human clinicians in patient care, but see a future where the triad of patient, human clinician and AI helps to provide our patients with the very best evidence-based care possible," said Cohen.

Publication details

Peter G Brodeur et al, Conversational diagnostic artificial intelligence in ambulatory primary care: a prospective feasibility study, The Lancet (2026). DOI: 10.1016/s0140-6736(26)01535-7

Journal information: The Lancet

Clinical categories

Family medicine

Who's behind this story?

Lisa Lock

Lisa Lock

BA art history, MA material culture. Former museum editor, paramedic, and transplant coordinator. Editing for Science X since 2021. Full profile →

Andrew Zinin

Andrew Zinin

Master's in physics with research experience. Long-time science news enthusiast. Plays key role in Science X's editorial success. Full profile →

Citation: First real-world study of safety and quality of patient-facing AI in primary care (2026, October 9) retrieved 9 October 2026 from https://medicalxpress.com/news/2026-10-real-world-safety-quality-patient.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

来源:Medical Xpress · medicalxpress.com