paper-with-me

홈 › Papers

Multi-scale Masked Autoencoder for Electrocardiogram Anomaly Detection

2025-02-08 · Ya Zhou, Yujie Yang, Jianhuang Gan, Xiangjie Li, Jing Yuan, Wei Zhao

Electrocardiogram (ECG) analysis is a fundamental tool for diagnosing cardiovascular conditions, yet anomaly detection in ECG signals remains challenging due to their inherent complexity and variability. We propose Multi-scale Masked Autoencoder for ECG anomaly detection (MMAE-ECG), a novel end-to-end framework that effectively captures both global and local dependencies in ECG data. Unlike state-of-the-art methods that rely on heartbeat segmentation or R-peak detection, MMAE-ECG eliminates the need for such pre-processing steps, enhancing its suitability for clinical deployment. MMAE-ECG partitions ECG signals into non-overlapping segments, with each segment assigned learnable positional embeddings. A novel multi-scale masking strategy and multi-scale attention mechanism, along with distinct positional embeddings, enable a lightweight Transformer encoder to effectively capture both local and global dependencies. The masked segments are then reconstructed using a single-layer Transformer block, with an aggregation strategy employed during inference to refine the outputs. Experimental results demonstrate that our method achieves performance comparable to state-of-the-art approaches while significantly reducing computational complexity-approximately 1/78 of the floating-point operations (FLOPs) required for inference. Ablation studies further validate the effectiveness of each component, highlighting the potential of multi-scale masked autoencoders for anomaly detection.

📄 PDF Abstract BibTeX arXiv:2502.05494

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly Detection

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

ODDObjects: A Framework for Multiclass Unsupervised Anomaly Detection on Masked Objects

2021-04-26 · Ricky Ma

This paper presents a novel framework for unsupervised anomaly detection on masked objects called ODDObjects, which stands for Out-of-Distribution Detection on Objects. ODDObjects is designed to detect anomalies of vario…

Anomaly DetectionImage ReconstructionObject RecognitionOut-of-Distribution Detection+1

Q-Former Autoencoder: A Modern Framework for Medical Anomaly Detection

2025-07-24 · Francesco Dalmonte, Emirhan Bayar, Emre Akbas, Mariana-Iuliana Georgescu arxiv

Anomaly detection in medical images is an important yet challenging task due to the diversity of possible anomalies and the practical impossibility of collecting comprehensively annotated data sets. In this work, we tack…

Anomaly Detection

Multi-scale Cross-restoration Framework for Electrocardiogram Anomaly Detection

2023-08-03 · Aofan Jiang, Chaoqin Huang, Qing Cao, Shuang Wu 외

Electrocardiogram (ECG) is a widely used diagnostic tool for detecting heart conditions. Rare cardiac diseases may be underdiagnosed using traditional ECG analysis, considering that no training dataset can exhaust all po…

Anomaly DetectionDiagnosticRhythm

Unsupervised Representation Learning and Anomaly Detection in ECG Sequences

2019-08-01 · João Pereira, Margarida Silveira

While the big data revolution takes place, large amounts of electronic health records, such as electrocardiograms (ECGs) and vital signs data, have become available. These signals are often recorded as time series of obs…

Anomaly DetectionClusteringRepresentation LearningTime Series+2

Masked Autoencoders for Unsupervised Anomaly Detection in Medical Images

2023-07-14 · Mariana-Iuliana Georgescu

Pathological anomalies exhibit diverse appearances in medical imaging, making it difficult to collect and annotate a representative amount of data required to train deep learning models in a supervised setting. Therefore…

Anomaly DetectionUnsupervised Anomaly Detection