跳到正文
原文
Nature 健康护理主题·· 13 天前AI 评分35

NeuroFusionNet: 结合Swin Transformer和CNN-RNN的脑肿瘤分割与分类框架

NeuroFusionNet: an integrated Swin Transformer and CNN–RNN framework

AI 导读

该研究提出了一种结合Swin Transformer和CNN-RNN的新型多模态深度学习架构,用于MRI图像中的脑肿瘤分割与分类。该模型在BraTS 2023数据集上的准确率为85.6%,F1分为85%,优于其他现有模型。此框架能够准确分割和分类临床MRI图像中的脑肿瘤,有助于提高临床诊断和治疗效率。

正文

Scientific Reports (2026) Cite this article

We’re sharing this article early to provide faster access to peer-reviewed, accepted research. It is citable and carries a permanent DOI. This version is subject to further edits and will be replaced automatically by the final Version of Record. All legal disclaimers apply.

Abstract

This paper proposes a novel multimodal deep learning architecture to address the challenging task of brain tumor segmentation and classification from MRI images. The model combines the strengths of Swin Transformer, Recurrent Neural Networks (RNNs), and Convolutional Neural Networks (CNNs) to achieve strong segmentation and classification performance. Using the three-dimensional and sequential features of MRI images, the model provides comprehensive and precise brain tumor analysis. The framework consists of two primary segments: Swin Transformer and CNN-RNN. The Swin Transformer module extracts spatial features from MRI images by using a hierarchical approach to capture multi-scale features. This module provides a strong representation of tumor spatial features, which is crucial for precise segmentation and classification. The CNN-RNN module captures sequential relationships present in MRI images. The module leverages the CNN-RNN integration to capture progressive correlations between images. By combining the spatial features extracted by the Swin Transformer module with the sequential features captured by the CNN-RNN module, the framework provides a complete representation of brain tumors. The proposed method achieved an accuracy of 85.6% compared with other existing deep learning models. The proposed model also achieved an F1 score of 85%, which is also superior to other existing models. It uses the BraTS 2023 dataset for multimodal brain tumor segmentation and classification, with pixel intensity values from 0 to 255, and employs an 80/10/10 training-validation-testing split. The framework’s ability to accurately segment and classify brain tumors in clinical MRI images could help clinicians diagnose and treat brain tumors more effectively. Medical practitioners can use our proposed approach to quickly correlate patients’ MRI details to analyse tumor presence. Moreover, the framework’s modular design allows easy implementation across other medical imaging tasks, making it a valuable resource for evaluating medical images.

Funding

The authors declare that no funds, grants, or other support were received during the preparation of this manuscript.

Author information

Authors and Affiliations

  1. School of Computer Science & Artificial Intelligence, SR University, Warangal, 506371, Telangana, India

    Faiza Iram & Mohammed Ali Shaik

Authors

  1. Faiza Iram
  2. Mohammed Ali Shaik

Corresponding author

Correspondence to Faiza Iram.

Ethics declarations

Competing interests

The authors declare no competing interests.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Consent for publication

Not applicable.

Consent to participate

Not applicable.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Iram, F., Shaik, M.A. NeuroFusionNet: an integrated Swin Transformer and CNN–RNN framework. Sci Rep (2026). https://doi.org/10.1038/s41598-026-78737-2

Download citation

  • Received: 23 July 2026

  • Accepted: 27 October 2026

  • Published: 07 November 2026

  • DOI: https://doi.org/10.1038/s41598-026-78737-2

Keywords

来源:Nature 健康护理主题 · nature.com