Multimodal deep feature fusion with transformer for brain tumor classification from magnetic resonance imaging.
Overview
- Department of Computer Science and Engineering, Jain Deemed To Be University, Bangalore, Karnataka 562112 India
- School of Computing, Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Avadi, Chennai, India
- Department of Computer Science and Engineering, Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Avadi, Chennai, 600062 India
- School of Computer Science and Applications, S-VYASA (Deemed to be University), Bengaluru, Karnataka 560059 India
- School of Computer Applications, Kalinga Institute of Industrial Technology (KIIT) Deemed to be University, Bhubaneswar, India
- School of Computer Science & Engineering, VIT-AP University, Amaravati, Andhra Pradesh India
- Department of AI&DS, ICFAITECH, Faculty of Science and Technology), IFHE, Hyderabad, India
Abstract
Brain tumors (BTs) arise due to abnormal cell growth, which has a high mortality rate globally. Millions of lives can be saved through the timely identification of BT. Precise identification and segmentation of BTs are essential to enhance the precision of analysis and the efficiency of therapeutic strategies. Magnetic resonance imaging (MRI) is a broadly utilized analytical tool. Furthermore, deep learning (DL) has recently shown efficiency in addressing several computer vision tasks. Several DL-driven methods are implemented for BT segmentation and attained impressive outcomes. This study presents a Multimodal Deep Feature Fusion Framework for Automated Brain Tumor Detection and Segmentation (MDFF-ABTDS) model. This objective is to develop a multimodal DL that integrates feature fusion and transformer networks for the precise detection and segmentation of BTs from medical images. Initially, image pre-processing is performed using Contrast Limited Adaptive Histogram Equalization (CLAHE) and image normalization. Feature extraction is carried out through fusion models such as CapsNet, ResNet-50, and AlexNet. These extracted features are then passed to a bi-directional convolutional long short-term memory combined with transformer (TBConvL-Net) models to classify tumors and non-tumors effectively. Finally, the tumor is classified to identify its location using the nnUNet model for a precise segmentation process. A series of experimental analyses of the MDFF-ABTDS method portrayed a superior accuracy value of 98.91% over existing models under the BT MRI dataset.
Reproduced under the paper's license (CC BY), from the paper cited above.
Code
The paper links to its data and to no code of its authors: see the Data section.
Tracing map
A tracing map links a paper to the code its authors published: this paper has none, so it has no map.
Data
Datasets cited
- kaggle.com/
datasets/ , at Kaggle; found in the referencesaryanfelix - kaggle.com/
datasets/ , at Kaggle; found in “Data availability”masoudnickparvar
Data availability
The data that support the findings of this study are openly available in the Kaggle repository at https://
Reproduced under the paper's license (CC BY), from the paper cited above.
Versions
The history of this record: each version stored by the harvester or made by a correction of its authors or of the maintainers of its code, and what changed in its facts. The texts of the paper (its abstract, its availability statements) are not part of it; versions that changed only those are not listed.
Version 1, 29 September 2026: the first record
Recorded: type, language, journal, volume, issue, pages, dates, 7 authors, 12 keywords, 7 MeSH terms, 13 references.
Cite
This paper
Pajany, M., Boopalan, K., Rajesh, R., JaiSingh, W., Dash, B. B., Rout, S. K., & Kumar, P. P. (2026). Multimodal deep feature fusion with transformer for brain tumor classification from magnetic resonance imaging. Scientific reports, 16(1), 17041. https://
BibTeX
@article{pajany2026multi
author = {Pajany, M and Boopalan, K and Rajesh, R and JaiSingh, W and Dash, Bibhuti Bhusan and Rout, Saroja Kumar and Kumar, P Pavan},
title = {{Multimodal deep feature fusion with transformer for brain tumor classification from magnetic resonance imaging}},
journal = {Scientific reports},
year = {2026},
month = apr,
volume = {16},
number = {1},
pages = {17041},
publisher = {Nature Publishing Group},
issn = {2045-2322},
doi = {10.1038/
url = {https://
pmid = {41965397},
pmcid = {PMC13230644}
}
RIS
TY - JOUR
AU - Pajany, M
AU - Boopalan, K
AU - Rajesh, R
AU - JaiSingh, W
AU - Dash, Bibhuti Bhusan
AU - Rout, Saroja Kumar
AU - Kumar, P Pavan
TI - Multimodal deep feature fusion with transformer for brain tumor classification from magnetic resonance imaging
T2 - Scientific reports
J2 - Sci Rep
PY - 2026
DA - 2026/
VL - 16
IS - 1
SP - 17041
SN - 2045-2322
PB - Nature Publishing Group
DO - 10.1038/
UR - https://
LA - en
ER -
CSL-JSON
{
"id": "10.1038/
"type": "article-journal",
"title": "Multimodal deep feature fusion with transformer for brain tumor classification from magnetic resonance imaging",
"container-title": "Scientific reports",
"author": [
{
"family": "Pajany",
"given": "M"
},
{
"family": "Boopalan",
"given": "K"
},
{
"family": "Rajesh",
"given": "R"
},
{
"family": "JaiSingh",
"given": "W"
},
{
"family": "Dash",
"given": "Bibhuti Bhusan"
},
{
"family": "Rout",
"given": "Saroja Kumar"
},
{
"family": "Kumar",
"given": "P Pavan"
}
],
"container-title-short":
"volume": "16",
"issue": "1",
"page": "17041",
"DOI": "10.1038/
"PMID": "41965397",
"PMCID": "PMC13230644",
"ISSN": "2045-2322",
"publisher": "Nature Publishing Group",
"URL": "https://
"language": "en",
"issued": {
"date-parts": [
[
2026,
4,
11
]
]
}
}
Similar papers
The papers with a page that share the most with this one: the tools found in their code, their categories, datasets, cited references and authors, the rarest counting most.
- [1] doi:10.1038/s41598-025-23100-0
- Hierarchical multi-scale vision transformer model for accurate detection and classification of brain tumors in MRI-based medical imaging.Journal: Scientific reportsIn common: kaggle.com/datasets/masoudnickparvar, methods / tools, structural MRI / diffusion, other condition, 4 references
- [2] doi:10.1038/s41598-026-43616-3
- MM FD ConvFormer multimodal frequency aware deformable CNN transformer network for robust brain tumor classification.Journal: Scientific reportsIn common: kaggle.com/datasets/masoudnickparvar, methods / tools, structural MRI / diffusion, other condition, 2 references
- [3] doi:10.3390/diagnostics15030249
- Feasibility Study of Detecting and Segmenting Small Brain Tumors in a Small MRI Dataset with Self-Supervised Learning.Journal: Diagnostics (Basel, Switzerland)In common: kaggle.com/datasets/masoudnickparvar, methods / tools, structural MRI / diffusion, other condition, 2 references
- [4] doi:10.1371/journal.pone.0344291
- Deep learning based two-way feature depiction model for brain tumor detection.Journal: PloS oneIn common: kaggle.com/datasets/masoudnickparvar, methods / tools, structural MRI / diffusion, other condition, 2 references
- [5] doi:10.1038/s41598-025-14901-4
- Enhanced MRI brain tumor detection using deep learning in conjunction with explainable AI SHAP based diverse and multi feature analysis.Journal: Scientific reportsIn common: kaggle.com/datasets/masoudnickparvar, methods / tools, structural MRI / diffusion, other condition, 2 references
- [6] doi:10.3390/diagnostics15192485
- A Robust Semi-Supervised Brain Tumor MRI Classification Network for Data-Constrained Clinical Environments.Journal: Diagnostics (Basel, Switzerland)In common: kaggle.com/datasets/masoudnickparvar, structural MRI / diffusion, other condition, 2 references
- [7] doi:10.3390/diagnostics15151863
- Role of Feature Diversity in the Performance of Hybrid Models-An Investigation of Brain Tumor Classification from Brain MRI Scans.Journal: Diagnostics (Basel, Switzerland)In common: kaggle.com/datasets/masoudnickparvar, structural MRI / diffusion, other condition, 2 references
- [8] doi:10.1038/s41598-026-50213-x
- Neuroimaging and machine learning fusion for improved brain tumor diagnosis and prognosis.Journal: Scientific reportsIn common: kaggle.com/datasets/masoudnickparvar, structural MRI / diffusion, other condition, 2 references
- [9] doi:10.1007/s12672-025-03501-3
- Improved brain tumor classification through DenseNet121 based transfer learning.Journal: Discover oncologyIn common: kaggle.com/datasets/masoudnickparvar, other condition, 2 references
- [10] doi:10.1038/s41598-026-48825-4
- YOLO-LS: a novel deep learning framework for brain tumor segmentation in Magnetic Resonance Imaging.Journal: Scientific reportsIn common: kaggle.com/datasets/masoudnickparvar, methods / tools, structural MRI / diffusion, other condition, 1 reference
Contribute
The authors of this paper can claim it, correct its record and validate its tracing map, and the maintainers of its code (its owner, or a public member of its organization) correct what it says of their repository; anyone signed in can ask for its removal. Every request goes to OSCR's own machine, which answers it; your account page follows them.
Sign in with ORCID to claim this paper as one of its authors, correct its record or validate its tracing map: when the paper's metadata lists your ORCID iD, you are recognized at once. Maintainers of its code: sign in with GitHub, then claim the repository on your account page.
Claim this paper
Correct its record
Say what each link of this record is, remove the ones that are not the paper's, add the ones that are missing. The correction becomes a new version of the record, in its Versions section.
Request its removal
To ask OSCR to remove this record, the copies of its authors' scripts or its tracing map, use the removal request page: signed in, you say who you are, what to remove and why, then review and confirm the request. Published rules decide every request (how).
Discussion, reproductions, activity
Discussion: code errors and mismatches between the code and the paper about this paper and its code, from readers and its authors, beside the paper and its tracing map.
Reproductions: reports from readers who ran the authors' code and did not get the paper's result, what they ran, with which environment, commit and data.
Activity: what happens around this paper: new versions of its record, its map's validation, discussions and reproductions. It opens with sign-in.
