多模态人工智能作为标准化非人类评分者:在健康相关视觉刺激中操作化生物可解释性
Operationalizing biological interpretability in health-related visual stimuli using multimodal artificial intelligence as standardized non-human raters
研究基于生物心理社会模型开发了Asclepius生物可解释性量表,并验证多模态AI能否复现应用该框架。AI在生物医学子量表上的评估具高信度(ICC 0.90–0.97),但日间稳定性差(ICC 0.04–0.46)。结果初步支持在受控环境下使用AI作为标准化非人类评分者的可行性。
- Article
- Open access
- Published: 12 October 2026
Scientific Reports (2026) Cite this article
We’re sharing this article early to provide faster access to peer-reviewed, accepted research. It is citable and carries a permanent DOI. This version is subject to further edits and will be replaced automatically by the final Version of Record. All legal disclaimers apply.
Abstract
Evaluation and assessment research in health communication requires structured, construct-based approaches for interpreting visual materials. This study introduces the Asclepius Biological Interpretability Scale, developed through a two-stage modified Delphi process (a joint image-and-item panel followed by an independent item-only panel) grounded in the Biopsychosocial Model and Visual Literacy Theory, and examines whether multimodal artificial intelligence (AI) systems can reproducibly apply this framework relative to internally generated human reference scores. Six artworks (four health-themed and two controls) were evaluated by three multimodal AI models and four researchers (internal human reference) using a standardized protocol with independent researcher-operated accounts, memory-isolation procedures, repeated assessments over two days, and the final 20-item scale. Because Image Type varied across only six stimuli, health-themed versus control differences were summarized at the image level (Cohen’s d), human–AI differences were summarized descriptively at the rater level, and reproducibility was assessed using intraclass correlation coefficients (ICC) and Spearman correlations. Within this development image set, AI-generated scores were descriptively higher for health-themed than for control images on the three biomedical subscales (image-level Cohen’s d = 0.91–1.38) but not on Non-Medical Interpretability (d = 0.49); with four health-themed and two control images, these differences were not statistically significant (p = 0.19–0.60). Reproducibility across researcher-operated accounts was excellent for the three biomedical subscales (ICC = 0.90–0.97) and moderate for Non-Medical Interpretability (ICC = 0.57), whereas agreement across assessment days was poor (ICC = 0.04–0.46). The four researchers’ internal reference scores were higher than the AI-generated scores on the biomedical subscales for health-themed images (mean differences 1.41–1.96 points) and lower on Non-Medical Interpretability (− 2.02 to − 2.19 points). These findings provide preliminary methodological evidence that multimodal AI can reproducibly apply a structured interpretability framework to controlled visual stimuli. Although day-to-day stability and the Non-Medical Interpretability subscale, which showed substantial internal-consistency problems, require further refinement, the results support the feasibility of using AI as standardized non-human raters within controlled methodological settings. Broader validation using authentic health communication materials and independent external human raters remains necessary.
Acknowledgements
Figures 1 and 2 and Supplementary Figures S1–S2 were computer-generated (Canva standard application) by Dr. Selçuk Uylaş, a research assistant in Internal Medicine (Mugla Education and Research Hospital) whose design, computer, and visual skills I know and trust, after the authors’ pencil sketch and summary of the topic were explained. We thank him for his scientific support.
Author information
Authors and Affiliations
Vefa High School, International Baccalaureate (IB) Diploma Programme Student, Istanbul, Turkey
Doruk Ayman
Independent Researcher, Retired Primary School Teacher, Istanbul, Turkey
Hatice Ozkan
Independent Researcher, Acıbadem Health Group, Dentistry, Istanbul, Turkey
Deniz Ayman
Faculty of Medicine, Department of Medical Oncology, Mugla Sitki Kocman University, Kötekli Mh. Marmaris Yolu Bulvarı No: 55 Menteşe, Mugla, 48000, Turkey
Ozgur Tanriverdi
Authors
- Doruk Ayman
- Hatice Ozkan
- Deniz Ayman
- Ozgur Tanriverdi
Corresponding author
Correspondence to Ozgur Tanriverdi.
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Ayman, D., Ozkan, H., Ayman, D. et al. Operationalizing biological interpretability in health-related visual stimuli using multimodal artificial intelligence as standardized non-human raters. Sci Rep (2026). https://doi.org/10.1038/s41598-026-75309-2
Received: 18 March 2026
Accepted: 06 October 2026
Published: 12 October 2026
DOI: https://doi.org/10.1038/s41598-026-75309-2
Keywords
来源:Nature 健康护理主题 · nature.com