Pipeline evaluation of a state-of-the-art AI algorithm for detection of focal cortical dysplasia: insights into potential failure sources.
Overview
- Pediatric Radiology, Department of Radiology, Stanford University School of Medicine, Stanford, CA USA
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria
Abstract
Purpose: MELD Graph is a state-of-the-art artificial intelligence (AI) model for automated detection of focal cortical dysplasia (FCD), but its performance remains limited, highlighting the need to investigate which aspects of the pipeline affect its accuracy.
Methods: A retrospective failure-mode analysis of the MELD Graph pipeline was performed in 242 subjects, with model predictions and FreeSurfer segmentations reviewed to classify errors as segmentation-associated or algorithm-related. FCD imaging features salient to humans were quantified, with statistical associations examined for both MELD Graph detection and focal FreeSurfer segmentation failure.
Results: MELD Graph demonstrated overall performance similar to previously published non-harmonized results, achieving a sensitivity of 69%, specificity of 44%, and positive predictive value (PPV) of 75%. Focal FreeSurfer segmentation failures were associated with 21% of false negative patients, 25% of false positive clusters in patients, and 16% of false positive clusters in controls. Following manual cortical segmentation correction and rerunning of MELD Graph, 67% of the segmentation-associated missed lesions were detected, and segmentation-associated false positive clusters were reduced or eliminated in 75% of controls with such clusters. Higher conspicuity on T1-weighted images was associated with MELD Graph detection, whereas greater conspicuity on T2-FLAIR images relative to T1 was associated with detection failure. Non–bottom-of-sulcus lesion location, higher human conspicuity measures, and low T1 image quality were positively associated with focal FreeSurfer segmentation failures.
Conclusion: FreeSurfer segmentation failures are a significant potential source of error in the MELD Graph pipeline. FCD imaging features salient to humans and image quality were also associated with variability in algorithm performance. Robust cortical segmentation and stronger integration of T2-FLAIR imaging features may be beneficial for automated FCD detection tools.
Clinical trial registration: Not applicable. This study is a retrospective analysis of previously acquired open-source imaging datasets and does not constitute a clinical trial.
Supplementary Information: The online version contains supplementary material available at 10.1186/
Reproduced under the paper's license (CC BY), from the paper cited above.
Code
The paper says that its authors' code is available on request: it was not published with the paper, so there is nothing to verify.
The paper's code and data availability statement is in the Data section.
Tracing map
A tracing map links a paper to the code its authors published: this paper has none (its code is available on request), so it has no map.
Data
Datasets cited
- openneuro:ds004199, at OpenNeuro; found in “Data availability”
- openneuro:ds005602, at OpenNeuro; found in “Data availability”
Data availability
The datasets supporting the conclusions of this article are available in the OpenNeuro repository: Bonn Open Presurgery MRI Dataset of people with epilepsy and focal cortical dysplasia type II [11] (https://
Reproduced under the paper's license (CC BY), from the paper cited above.
Versions
The history of this record: each version stored by the harvester or made by a correction of its authors or of the maintainers of its code, and what changed in its facts. The texts of the paper (its abstract, its availability statements) are not part of it; versions that changed only those are not listed.
Version 1, 28 September 2026: the first record
Recorded: type, language, journal, volume, issue, pages, dates, 8 authors, 6 keywords, 22 references.
Cite
This paper
Esmeraldo, M. A., Chambers, S., Kravutske, Y., Reis, E. P., Kasprian, G., Geraldo, A. F., Gatidis, S., & Soares, B. P. (2026). Pipeline evaluation of a state-of-the-art AI algorithm for detection of focal cortical dysplasia: insights into potential failure sources. Brain informatics, 13(1), 13. https://
BibTeX
@article{esmeraldo2026pi
author = {Esmeraldo, Mateus A and Chambers, Stefanie and Kravutske, Yanniklas and Reis, Eduardo P and Kasprian, Gregor and Geraldo, Ana Filipa and Gatidis, Sergios and Soares, Bruno P},
title = {{Pipeline evaluation of a state-of-the-art AI algorithm for detection of focal cortical dysplasia: insights into potential failure sources}},
journal = {Brain informatics},
year = {2026},
month = apr,
volume = {13},
number = {1},
pages = {13},
publisher = {Springer},
issn = {2198-4018},
doi = {10.1186/
url = {https://
pmid = {41931246},
pmcid = {PMC13133319}
}
RIS
TY - JOUR
AU - Esmeraldo, Mateus A
AU - Chambers, Stefanie
AU - Kravutske, Yanniklas
AU - Reis, Eduardo P
AU - Kasprian, Gregor
AU - Geraldo, Ana Filipa
AU - Gatidis, Sergios
AU - Soares, Bruno P
TI - Pipeline evaluation of a state-of-the-art AI algorithm for detection of focal cortical dysplasia: insights into potential failure sources
T2 - Brain informatics
J2 - Brain Inform
PY - 2026
DA - 2026/
VL - 13
IS - 1
SP - 13
SN - 2198-4018
PB - Springer
DO - 10.1186/
UR - https://
LA - en
ER -
CSL-JSON
{
"id": "10.1186/
"type": "article-journal",
"title": "Pipeline evaluation of a state-of-the-art AI algorithm for detection of focal cortical dysplasia: insights into potential failure sources",
"container-title": "Brain informatics",
"author": [
{
"family": "Esmeraldo",
"given": "Mateus A"
},
{
"family": "Chambers",
"given": "Stefanie"
},
{
"family": "Kravutske",
"given": "Yanniklas"
},
{
"family": "Reis",
"given": "Eduardo P"
},
{
"family": "Kasprian",
"given": "Gregor"
},
{
"family": "Geraldo",
"given": "Ana Filipa"
},
{
"family": "Gatidis",
"given": "Sergios"
},
{
"family": "Soares",
"given": "Bruno P"
}
],
"container-title-short":
"volume": "13",
"issue": "1",
"page": "13",
"DOI": "10.1186/
"PMID": "41931246",
"PMCID": "PMC13133319",
"ISSN": "2198-4018",
"publisher": "Springer",
"URL": "https://
"language": "en",
"issued": {
"date-parts": [
[
2026,
4,
3
]
]
}
}
Similar papers
The papers with a page that share the most with this one: the tools found in their code, their categories, datasets, cited references and authors, the rarest counting most.
- [1] doi:10.1016/j.isci.2026.117446 [code]
- Volume-inflation registration (INFREG) for morphometric analysis of human focal cortical dysplasia type II.Journal: iScienceIn common: OpenNeuro ds004199, epilepsy, structural MRI / diffusion, 6 references
- [2] doi:10.1002/epi4.70336 [code]
- Quantifying extra-lesional interhemispheric cortical asymmetry in focal cortical dysplasia type II.Journal: Epilepsia openIn common: OpenNeuro ds004199, epilepsy, structural MRI / diffusion, 6 references
- [3] doi:10.64898/2026.04.02.26349812 [code]
- 9.4 Tesla MRI in focal epilepsy patients with high-resolution surface-based profiling of focal cortical dysplasiasJournal: medRxiv (preprint)In common: epilepsy, structural MRI / diffusion, 6 references
- [4] doi:10.1007/s00415-026-13850-w
- No link between piriform cortex subregion resection and seizure freedom in two cohorts with temporal lobe epilepsy.Journal: Journal of neurologyIn common: OpenNeuro ds005602, epilepsy, structural MRI / diffusion, 1 reference
- [5] doi:10.1007/s00234-026-04103-8 [code]
- Enhanced detection of subtle cortical abnormalities in focal epilepsy using 7 T MRI surface-based models and graph neural networks.Journal: NeuroradiologyIn common: epilepsy, structural MRI / diffusion, 5 references
- [6] doi:
- Structural and Quantitative MRI Signal Features in Pediatric Focal Cortical Dysplasia: Clinical Relevance.Journal: Physiological researchIn common: epilepsy, structural MRI / diffusion, 4 references
- [7] doi:10.1162/imag.a.1366 [code]
- MICAFlow: Fast and robust MRI preprocessing bridging research neuroimaging and clinical practice.Journal: Imaging neuroscience (Cambridge, Mass.)In common: epilepsy, methods / tools, structural MRI / diffusion, 3 references
- [8] doi:10.1371/journal.pone.0346132 [code]
- Analysis of cortical dysplasias using b-tensor encoding diffusion MRI in an animal model.Journal: PloS oneIn common: structural MRI / diffusion, 3 references
- [9] doi:10.1038/s41598-026-51531-w [code]
- Multimodal age-dependent diffusion-MRI analysis of the neocortex in a rat model of cortical dysplasia.Journal: Scientific reportsIn common: structural MRI / diffusion, 3 references
- [10] doi:10.64898/2026.08.13.26359403 [code]
- NeuroMorph: A Unified Morphological Reference Space for Cross-Disease Brain ProfilingJournal: medRxiv (preprint)In common: structural MRI / diffusion, 3 references
Contribute
The authors of this paper can claim it, correct its record and validate its tracing map, and the maintainers of its code (its owner, or a public member of its organization) correct what it says of their repository; anyone signed in can ask for its removal. Every request goes to OSCR's own machine, which answers it; your account page follows them.
Sign in with ORCID to claim this paper as one of its authors, correct its record or validate its tracing map: when the paper's metadata lists your ORCID iD, you are recognized at once. Maintainers of its code: sign in with GitHub, then claim the repository on your account page.
Claim this paper
Correct its record
Say what each link of this record is, remove the ones that are not the paper's, add the ones that are missing. The correction becomes a new version of the record, in its Versions section.
Request its removal
To ask OSCR to remove this record, the copies of its authors' scripts or its tracing map, use the removal request page: signed in, you say who you are, what to remove and why, then review and confirm the request. Published rules decide every request (how).
Discussion, reproductions, activity
Discussion: questions and error reports about this paper and its code, from signed-in readers and its authors. It opens with sign-in.
Reproductions: reports from readers who ran the authors' code: what they reproduced, with which environment, commit and data. It opens with sign-in.
Activity: what happens around this paper: new versions of its record, its map's validation, discussions and reproductions. It opens with sign-in.