MSAT-KOA-Net: 多尺度注意力变换网络结合检索增强知识进行可解释性膝关节骨关节炎分级
MSAT-KOA-Net: a multi-scale attention transformer network with retrieval-augmented knowledge (RAG) for interpretable knee osteoarthritis grading
该研究提出了一种名为 MSAT-KOA-Net 的多尺度注意力变换网络,结合检索增强知识模块,用于放射影像中膝关节骨关节炎的准确分级。该模型在验证集上的准确率为 80.09%,Kappa 值为 0.8523,优于基线模型,提高了骨关节炎严重程度分类的有效性和解释性。
- Article
- Open access
- Published: 08 October 2026
Scientific Reports (2026) Cite this article
We’re sharing this article early to provide faster access to peer-reviewed, accepted research. It is citable and carries a permanent DOI. This version is subject to further edits and will be replaced automatically by the final Version of Record. All legal disclaimers apply.
Abstract
Knee Osteoarthritis (KOA) has become the leading degenerative joint problem affecting humans across the world, causing disability among the elderly population. The radiographic evaluation of KOA is often performed using the Kellgren–Lawrence grading system; however, grading is subjective and depends on expertise. Recently, deep learning (DL) models have shown promising results for KOA diagnosis; however, these approaches have limitations in representing multi-scale anatomical features, focusing on joint regions of interest, modelling global relationships between features, and interpretability of results. In this paper, a novel Multi-Scale Attention Transformer Network (MSAT-KOA-Net) architecture has been proposed for accurate grading of knee osteoarthritis from radiographic images while maintaining interpretability of results. The proposed architecture combines an EfficientNet-B4 backbone network with a multi-scale feature fusion layer, a Convolutional Block Attention Module (CBAM), and a joint space attention mechanism to achieve discriminative feature representation of knee joint structures. Furthermore, a transformer encoder is employed to encode global contextual relationships between the extracted features. Additionally, an ordinal focal loss function is used to effectively learn the ordered relationships of KL grades and address the class imbalance issue. In addition to classification, a Retrieval-Augmented Generation (RAG) module is employed to improve the model’s interpretability by retrieving relevant medical knowledge from scientific literature via FAISS-based semantic search and generating contextual explanations with a large language model. The proposed MSAT-KOA-Net framework performance is evaluated with the knee X-ray dataset, and the results show that the proposed framework outperforms the baseline models with a validation accuracy of 80.09% and a Quadratic Weighted Kappa score of 0.8523, thus validating the effectiveness of the proposed framework for improving the classification of KOA severity and providing relevant explanations for the decision-making process, which is very helpful for the diagnosis of osteoarthritis.
Author information
Authors and Affiliations
Department of Orthopedics, The First Affiliated Hospital of Anhui Medical University, No. 218, Jixi Road, Shushan District, Hefei, 230000, China
Shaowei Jiang & Bin Xu
Department of Computer Science and Engineering, Karunya Institute of Technology and Sciences, Karunya Nagar, Coimbatore, 641114, India
K. Venkatachalam
Institute for Sustainable Industries and Liveable Cities, Victoria University, Melbourne, VIC, Australia
Siuly Siuly
Authors
- Shaowei Jiang
- Bin Xu
- K. Venkatachalam
- Siuly Siuly
Corresponding author
Correspondence to Bin Xu.
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.
About this article
Cite this article
Jiang, S., Xu, B., Venkatachalam, K. et al. MSAT-KOA-Net: a multi-scale attention transformer network with retrieval-augmented knowledge (RAG) for interpretable knee osteoarthritis grading. Sci Rep (2026). https://doi.org/10.1038/s41598-026-70977-6
Received: 17 June 2026
Accepted: 07 September 2026
Published: 08 October 2026
DOI: https://doi.org/10.1038/s41598-026-70977-6
Keywords
来源:Nature 健康护理主题 · nature.com