paper-with-me

홈 › Papers

ECG-biometrics-bench: A Unified Framework for Reproducible Benchmarking of ECG Biometrics

2026-05-02 · Milad Parvan arxiv

Electrocardiogram (ECG) biometrics have emerged as a promising modality for continuous, liveness-aware authentication in wearable systems. However, many prior studies report overly optimistic results due to data leakage (e.g., random splits within the same session). To address this issue, we introduce ECG-biometrics-bench, a modular, reproducible benchmarking framework that standardizes preprocessing, segmentation, and evaluation across seven widely used public ECG datasets spanning clinical, ambulatory, and large-scale cohort settings. The framework supports both closed-set and open-set (i.e., subject-disjoint generalization in this work) evaluation, as well as progressively realistic protocols including cross-session and long-term temporal separation. To facilitate reproducible research in the community, the ECG-biometrics-bench repository will be made publicly accessible on GitHub upon the acceptance of this manuscript. Through a comprehensive multi-dataset analysis, we expose the Random Split Fallacy, demonstrating that intra-session evaluation protocols artificially inflate performance while masking severe degradation caused by temporal drift and unseen identities. Furthermore, by evaluating multiple architectures, including DeepECG, ResNet1D, and CNN-LSTM, we show that these failures are not model-specific but are likely inherent to current supervised feature-learning paradigms. Finally, we demonstrate that performance degradation due to temporal aging can be partially mitigated through a heavy enrollment, lightweight authentication strategy based on dynamic multi-session template fusion. These findings establish a more realistic baseline for ECG biometrics and highlight critical challenges that must be addressed for reliable real-world deployment.

📄 PDF Abstract BibTeX arXiv:2605.01548

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

RBoard: A Unified Platform for Reproducible and Reusable Recommender System Benchmarks

2024-09-09 · Xinyang Shao, Edoardo D'Amico, Gabor Fodor, Tri Kurniawan Wijaya

Recommender systems research lacks standardized benchmarks for reproducibility and algorithm comparisons. We introduce RBoard, a novel framework addressing these challenges by providing a comprehensive platform for bench…

BenchmarkingClick-Through Rate PredictionRecommendation Systems

PathBench-MIL: A Comprehensive AutoML and Benchmarking Framework for Multiple Instance Learning in Histopathology

2025-12-19 · Siemen Brussee, Pieter A. Valkema, Jurre A. J. Weijer, Thom Doeleman 외 arxiv

We introduce PathBench-MIL, an open-source AutoML and benchmarking framework for multiple instance learning (MIL) in histopathology. The system automates end-to-end MIL pipeline construction, including preprocessing, fea…

Multiple Instance Learning

Bencher: Simple and Reproducible Benchmarking for Black-Box Optimization

2025-05-27 · Leonard Papenmeier, Luigi Nardi

We present Bencher, a modular benchmarking framework for black-box optimization that fundamentally decouples benchmark execution from optimization logic. Unlike prior suites that focus on combining many benchmarks in a s…

Benchmarking

RecAD: Towards A Unified Library for Recommender Attack and Defense

2023-09-09 · Changsheng Wang, Jianbai Ye, Wenjie Wang, Chongming Gao 외

In recent years, recommender systems have become a ubiquitous part of our daily lives, while they suffer from a high risk of being attacked due to the growing commercial and social values. Despite significant research pr…

BenchmarkingRecommendation Systems

Procrustean Bed for AI-Driven Retrosynthesis: A Unified Framework for Reproducible Evaluation

2025-12-08 · Anton Morgunov, Victor S. Batista arxiv

Progress in computer-aided synthesis planning (CASP) is obscured by the lack of standardized evaluation infrastructure and the reliance on metrics that prioritize topological completion over chemical validity. We introdu…