NeuroFusionNet: 结合Swin Transformer和CNN-RNN的脑肿瘤分割与分类框架
NeuroFusionNet: an integrated Swin Transformer and CNN–RNN framework
该研究提出了一种结合Swin Transformer和CNN-RNN的新型多模态深度学习架构,用于MRI图像中的脑肿瘤分割与分类。该模型在BraTS 2023数据集上的准确率为85.6%,F1分为85%,优于其他现有模型。此框架能够准确分割和分类临床MRI图像中的脑肿瘤,有助于提高临床诊断和治疗效率。
- Article
- Open access
- Published: 07 November 2026
Scientific Reports (2026) Cite this article
We’re sharing this article early to provide faster access to peer-reviewed, accepted research. It is citable and carries a permanent DOI. This version is subject to further edits and will be replaced automatically by the final Version of Record. All legal disclaimers apply.
Abstract
This paper proposes a novel multimodal deep learning architecture to address the challenging task of brain tumor segmentation and classification from MRI images. The model combines the strengths of Swin Transformer, Recurrent Neural Networks (RNNs), and Convolutional Neural Networks (CNNs) to achieve strong segmentation and classification performance. Using the three-dimensional and sequential features of MRI images, the model provides comprehensive and precise brain tumor analysis. The framework consists of two primary segments: Swin Transformer and CNN-RNN. The Swin Transformer module extracts spatial features from MRI images by using a hierarchical approach to capture multi-scale features. This module provides a strong representation of tumor spatial features, which is crucial for precise segmentation and classification. The CNN-RNN module captures sequential relationships present in MRI images. The module leverages the CNN-RNN integration to capture progressive correlations between images. By combining the spatial features extracted by the Swin Transformer module with the sequential features captured by the CNN-RNN module, the framework provides a complete representation of brain tumors. The proposed method achieved an accuracy of 85.6% compared with other existing deep learning models. The proposed model also achieved an F1 score of 85%, which is also superior to other existing models. It uses the BraTS 2023 dataset for multimodal brain tumor segmentation and classification, with pixel intensity values from 0 to 255, and employs an 80/10/10 training-validation-testing split. The framework’s ability to accurately segment and classify brain tumors in clinical MRI images could help clinicians diagnose and treat brain tumors more effectively. Medical practitioners can use our proposed approach to quickly correlate patients’ MRI details to analyse tumor presence. Moreover, the framework’s modular design allows easy implementation across other medical imaging tasks, making it a valuable resource for evaluating medical images.
Funding
The authors declare that no funds, grants, or other support were received during the preparation of this manuscript.
Author information
Authors and Affiliations
School of Computer Science & Artificial Intelligence, SR University, Warangal, 506371, Telangana, India
Faiza Iram & Mohammed Ali Shaik
Authors
- Faiza Iram
- Mohammed Ali Shaik
Corresponding author
Correspondence to Faiza Iram.
Ethics declarations
Competing interests
The authors declare no competing interests.
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Consent for publication
Not applicable.
Consent to participate
Not applicable.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.
About this article
Cite this article
Iram, F., Shaik, M.A. NeuroFusionNet: an integrated Swin Transformer and CNN–RNN framework. Sci Rep (2026). https://doi.org/10.1038/s41598-026-78737-2
Received: 23 July 2026
Accepted: 27 October 2026
Published: 07 November 2026
DOI: https://doi.org/10.1038/s41598-026-78737-2
Keywords
来源:Nature 健康护理主题 · nature.com