paper-with-me

홈 › Papers

How You Split Matters: Data Leakage and Subject Characteristics Studies in Longitudinal Brain MRI Analysis

2023-09-01 · Dewinda Julianensi Rumala

Deep learning models have revolutionized the field of medical image analysis, offering significant promise for improved diagnostics and patient care. However, their performance can be misleadingly optimistic due to a hidden pitfall called 'data leakage'. In this study, we investigate data leakage in 3D medical imaging, specifically using 3D Convolutional Neural Networks (CNNs) for brain MRI analysis. While 3D CNNs appear less prone to leakage than 2D counterparts, improper data splitting during cross-validation (CV) can still pose issues, especially with longitudinal imaging data containing repeated scans from the same subject. We explore the impact of different data splitting strategies on model performance for longitudinal brain MRI analysis and identify potential data leakage concerns. GradCAM visualization helps reveal shortcuts in CNN models caused by identity confounding, where the model learns to identify subjects along with diagnostic features. Our findings, consistent with prior research, underscore the importance of subject-wise splitting and evaluating our model further on hold-out data from different subjects to ensure the integrity and reliability of deep learning models in medical image analysis.

📄 PDF Abstract BibTeX arXiv:2309.00350

Code (0)

등록된 구현이 없습니다.

Tasks

DiagnosticMedical Image Analysis

Similar Papers 제목 키워드 기반

Cross-Subject Data Splitting for Brain-to-Text Decoding

2023-12-18 · Congchi Yin, Qian Yu, Zhiwei Fang, Jie He 외

Recent major milestones have successfully decoded non-invasive brain signals (e.g. functional Magnetic Resonance Imaging (fMRI) and electroencephalogram (EEG)) into natural language. Despite the progress in model design,…

DecoderEEGElectroencephalogram (EEG)

Which Leakage Types Matter? A Quantitative Landscape Across 2,047 Benchmark Datasets

2026-04-05 · Simon Roth arxiv

Twenty-eight within-subject counterfactual experiments across 2,047 iid tabular datasets, plus a boundary experiment on 129 temporal datasets, measure the severity of four data leakage classes in machine learning. Class …

SplitFlux: Learning to Decouple Content and Style from a Single Image

2025-11-19 · Yitong Yang, Yinglin Wang, Changshuo Wang, Yongjun Zhang 외 arxiv

Disentangling image content and style is essential for customized image generation. Existing SDXL-based methods struggle to achieve high-quality results, while the recently proposed Flux model fails to achieve effective …

Image Generation

On Leakage in Some Popular Benchmarks on Graphs

2022-01-16 · ACL ARR January 2022 1 · Anonymous

A number of benchmarks are based on graphs. Edges are typically split into train, validation and test splits, using a random partition. Leakage has been discovered in a number of popular benchmarks; FB15k has been rep…

Effect of data leakage in brain MRI classification using 2D convolutional neural networks

2021-11-19 · Scientific Reports 2021 11 · Ekin Yagis, Selamawet Workalemahu Atnafu, Alba García Seco De Herrera, Chiara Marzi 외

In recent years, 2D convolutional neural networks (CNNs) have been extensively used to diagnose neurological diseases from magnetic resonance imaging (MRI) data due to their potential to discern subtle and intricate patt…

MRI classification