BrainTwin-AI: A Multimodal MRI-EEG-Based Cognitive Digital Twin for Real-Time Brain Health Intelligence.

Overview

1. Department of Computer Science, SNEC, University of Calcutta, Kolkata 700073, West Bengal, India
2. Department of Computer Science and Engineering (Specialization in Internet of Things), Institute of Engineering and Management, Kolkata 700091, West Bengal, India
3. Department of Computer Science and Engineering, University of Engineering and Management, Kolkata 700160, West Bengal, India
4. Department of Computer Science, Illinois Institute of Technology, Chicago, IL 60616, USA
5. Department of Computer Science, San Francisco State University, San Francisco, CA 94132, USA

Abstract

Background/Objectives: Brain health monitoring is increasingly essential as modern cognitive load, stress, and lifestyle pressures contribute to widespread neural instability. The paper presents BrainTwin, a next-generation cognitive digital twin, as a patient-specific, constantly updating computer model that combines state-of-the-art MRI analytics for neuro-oncological assessment related to clinical study and management of tumors affecting the central nervous system (including their detection, progression, and monitoring) with real-time EEG-based brain health intelligence. Methods: Structural analysis is driven by an Enhanced Vision Transformer (ViT++), which improves spatial representation and boundary localization, achieving more accurate tumor prediction than conventional models. The extracted tumor volume forms the baseline for short-horizon tumor progression modeling. Parallel to MRI analysis, continuous EEG signals are captured through an in-house wearable skullcap, preprocessed using Edge AI on a Hailo Toolkit-enabled Raspberry Pi 5 for low-latency denoising and secure cloud transmission. Pre-processed EEG packets are authenticated at the fog layer, ensuring secure and reliable cloud transfer, enabling significant load reduction in the edge and cloud nodes. In the digital twin, EEG characteristics offer real-time functional monitoring through dynamic brainwave analysis, while a BiLSTM classifier distinguishes relaxed, stress, and fatigue states, which are probabilistically inferred cognitive conditions derived from EEG spectral patterns. Unlike static MRI imaging, EEG provides real-time brain health monitoring. The BrainTwin performs EEG–MRI fusion, correlating functional EEG metrics with ViT++ structural embeddings to produce a single risk score that can be interpreted by clinicians to determine brain vulnerability to future diseases. Explainable artificial intelligence (XAI) provides clinical interpretability through gradient-weighted class activation mapping (Grad-CAM) heatmaps, which are used to interpret ViT++ decisions and are visualized on a 3D interactive brain model to allow more in-depth inspection of spatial details. Results: The evaluation metrics demonstrate a BiLSTM macro-F1 of 0.94 (Precision/Recall/F1: Relaxed 0.96, Stress 0.93, Fatigue 0.92) and a ViT++ MRI accuracy of 96%, outperforming baseline architectures. Conclusions: These results demonstrate BrainTwin’s reliability, interpretability, and clinical utility as an integrated digital companion for tumor assessment and real-time functional brain monitoring.

Reproduced under the paper's license (CC BY), from the paper cited above.

Code

No file of the authors' code could be read here: it is described below, and read at its source.

The paper's code and data availability statement is in the Data section.

Tracing map

Proposed by the machine: these links were found in the paper and verified at the source, without human review. The map will receive a Zenodo DOI once one of the paper's authors has validated it with their ORCID.

What the map holds:

• 1 repository of the authors' code, each at its verified commit, with its license and how the link was found in the paper;
• 0 scripts, each with its path and the digest of its content;
• no match between paragraphs and code yet;
• neither the text of the paper nor the code itself.

Its JSON (tracing-map.json) is deposited on Zenodo with its DOI once the map is validated.

Data

No dataset and no data link were found in the paper.

Data Availability Statement

The in-house EEG and MRI datasets generated and analyzed during the current study are not publicly available due to ethical and privacy considerations. External validation datasets used in this work, including BRaTS 2021 (MRI) and the TUH EEG Corpus, are publicly accessible. Detailed algorithmic implementations can be accessed through: https://github.com/UtshoBanerjee/BrainTwin (accessed on 19 January 2026). Additional anonymized data may be made available from the corresponding author upon reasonable request and subject to institutional approval.

Reproduced under the paper's license (CC BY), from the paper cited above.

Versions

The history of this record: each version stored by the harvester or made by a correction of its authors or of the maintainers of its code, and what changed in its facts. The texts of the paper (its abstract, its availability statements) are not part of it; versions that changed only those are not listed.

Version 1, 29 September 2026: the first record

Recorded: type, language, journal, volume, issue, pages, dates, 5 authors, 8 keywords, 20 references.

Cite

This paper

Saha, H. N., Banerjee, U., Karmakar, R., Banerjee, S., & Turdiev, J. (2026). BrainTwin-AI: A Multimodal MRI-EEG-Based Cognitive Digital Twin for Real-Time Brain Health Intelligence. Brain sciences, 16(4), 411. https://doi.org/10.3390/brainsci16040411

The tracing map gets a citation of its own once an author has validated it and it has a DOI.

Similar papers

The papers with a page that share the most with this one: the tools found in their code, their categories, datasets, cited references and authors, the rarest counting most.

[1] doi:10.1038/s41467-026-74460-8 [code]

Spike-based alignment learning solves the weight transport problem.

Journal: Nature communications

In common: 3 references

[2] doi:10.1073/pnas.2408125122 [code]

A general framework for interpretable neural learning based on local information-theoretic goal functions.

Journal: Proceedings of the National Academy of Sciences of the United States of America

In common: 3 references

[3] doi:10.7554/elife.89674 [code]

A neuronal least-action principle for real-time learning in cortical circuits.

Journal: eLife

In common: 3 references

[4] doi:10.7554/elife.88608 [code]

A neural network model of differentiation and integration of competing memories.

Journal: eLife

In common: 3 references

[5] doi:10.1038/s41593-023-01514-1 [code]

Inferring neural activity before plasticity as a foundation for learning beyond backpropagation.

Journal: Nature neuroscience

In common: 3 references

[6] doi:10.1073/pnas.2201304119 [code]

Multilevel development of cognitive abilities in an artificial neural network.

Journal: Proceedings of the National Academy of Sciences of the United States of America

In common: 3 references

[7] doi:10.1186/s12967-022-03710-2

Sleep patterns correlates with the efficacy of tDCS on post-stroke patients with prolonged disorders of consciousness.

Journal: Journal of translational medicine

In common: other, EEG, clinical / translational, 1 other category, 1 reference

[8] doi:10.1038/s41598-025-09311-5

Hybrid transfer learning and self-attention framework for robust MRI-based brain tumor classification.

Journal: Scientific reports

In common: structural MRI / diffusion, clinical / translational, other condition, 1 reference

[9] doi:10.1038/s41598-026-50158-1 [code]

NeXtSwin-X: dual-branch cross-attention fusion of ConvNeXt and swin transformer for accurate brain tumor classification from MRI and CT.

Journal: Scientific reports

In common: other, structural MRI / diffusion, other condition, 1 reference

[10] doi:10.1371/journal.pdig.0001374 [code]

Predicting multiple sclerosis from radiologically isolated syndrome using generative artificial intelligence.

Journal: PLOS digital health

In common: structural MRI / diffusion, clinical / translational, 1 reference

Contribute

The authors of this paper can claim it, correct its record and validate its tracing map, and the maintainers of its code (its owner, or a public member of its organization) correct what it says of their repository; anyone signed in can ask for its removal. Every request goes to OSCR's own machine, which answers it; your account page follows them.

<!-- oscr-badge:start -->
[![OSCR](https://openscicode.org/badge/doi/10.3390/brainsci16040411.svg)](https://openscicode.org/badge/doi/10.3390/brainsci16040411)
<!-- oscr-badge:end -->

.. oscr-badge:start

.. image:: https://openscicode.org/badge/doi/10.3390/brainsci16040411.svg
   :target: https://openscicode.org/badge/doi/10.3390/brainsci16040411
   :alt: OSCR

.. oscr-badge:end

<!-- oscr-badge:start -->
<a href="https://openscicode.org/badge/doi/10.3390/brainsci16040411"><img src="https://openscicode.org/badge/doi/10.3390/brainsci16040411.svg" alt="OSCR"></a>
<!-- oscr-badge:end -->

Request its removal

To ask OSCR to remove this record, the copies of its authors' scripts or its tracing map, use the removal request page: signed in, you say who you are, what to remove and why, then review and confirm the request. Published rules decide every request (how).

Discussion: code errors and mismatches between the code and the paper about this paper and its code, from readers and its authors, beside the paper and its tracing map.

Report a mismatch between the code and the paper · Report a code error (signed in)

Reproductions: reports from readers who ran the authors' code and did not get the paper's result, what they ran, with which environment, commit and data.

Report a reproduction failure (signed in)

Versions of its code: the releases of its code tied to a version of this paper (the preprint, the accepted manuscript, the version of record…), each with the tracing map versioned with it.

Activity: what happens around this paper: new versions of its record, its map's validation, discussions and reproductions. It opens with sign-in.