标准与解耦知识蒸馏在轻量级膝关节骨关节炎影像分级中的应用
Standard and decoupled knowledge distillation for lightweight radiographic knee osteoarthritis grading and triage
该研究比较了标准知识蒸馏(KD)和解耦知识蒸馏(DKD)在轻量级人工智能膝关节骨关节炎影像分级中的效果。使用Swin-Tiny教师模型和GhostNetV2学生模型,研究结果显示,DKD在减少KL-1到KL-2的误判方面优于标准KD,但KL-0召回率较低。尽管KD提高了内部性能,但DKD未显示额外的敏感性优势。
We’re sharing this article early to provide faster access to peer-reviewed, accepted research. It is citable and carries a permanent DOI. This version is subject to further edits and will be replaced automatically by the final Version of Record. All legal disclaimers apply.
Abstract
This retrospective study compares standard knowledge distillation (KD) and decoupled knowledge distillation (DKD) for lightweight artificial intelligence-based radiographic knee osteoarthritis grading. GhostNetV2 students learned five Kellgren–Lawrence grades from a Swin-Tiny teacher and were evaluated against a cross-entropy baseline using an Osteoarthritis Initiative-derived dataset of 8260 images from 4130 patients with patient-disjoint partitions. Across three runs, mean binary triage accuracy was 84.04%, 84.82%, and 84.82% for baseline, standard KD, and DKD. Thresholds targeting at least 90% validation specificity yielded test sensitivities of 72.77%, 76.56%, and 75.50%, with specificities of 92.09%, 90.94%, and 91.12%; these operating points are not specificity-matched. Mean five-class accuracy was 64.63%, 67.63%, and 67.71%. Separate illustrative checkpoints showed reduced KL-1-to-KL-2 overcalls with DKD (28.0 to 18.9%) but lower KL-0 recall (90.6 to 78.7%). Calibration, exploratory decision curves, and patient-cluster uncertainty intervals were evaluated. Each student contains 4.88 million parameters. Distillation improved mean performance internally, but decoupling did not demonstrate an additional sensitivity benefit over standard KD. No external cohort or clinician-supported decision policy was evaluated; clinical utility and population-level stability remain unestablished.
Acknowledgements
The Researchers would like to thank the Deanship of Graduate Studies and Scientific Research at Qassim University (https://www.qu.edu.sa) for financial support (QU-APC-2026).
Funding
The APC was funded by the Deanship of Graduate Studies and Scientific Research at Qassim University (https://www.qu.edu.sa) (QU-APC-2026).
Author information
Authors and Affiliations
Department of Electrical and Computer Engineering, School of Engineering and Physical Sciences, North South University, Dhaka, 1229, Bangladesh
Umar Hasan
Department of Computer Engineering, College of Computer, Qassim University, Buraydah, 51452, Saudi Arabia
Muhammad Ali Nayeem
Authors
- Umar Hasan
- Muhammad Ali Nayeem
Corresponding author
Correspondence to Muhammad Ali Nayeem.
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Hasan, U., Nayeem, M.A. Standard and decoupled knowledge distillation for lightweight radiographic knee osteoarthritis grading and triage. Sci Rep (2026). https://doi.org/10.1038/s41598-026-78270-2
Received: 20 January 2026
Accepted: 26 October 2026
Published: 31 October 2026
DOI: https://doi.org/10.1038/s41598-026-78270-2
来源:Nature 健康护理主题 · nature.com