paper-with-me

홈 › Papers

Unsupervised Multivariate Time-Series Transformers for Seizure Identification on EEG

2023-01-03 · İlkay Yıldız Potter, George Zerveas, Carsten Eickhoff, Dominique Duncan

Epilepsy is one of the most common neurological disorders, typically observed via seizure episodes. Epileptic seizures are commonly monitored through electroencephalogram (EEG) recordings due to their routine and low expense collection. The stochastic nature of EEG makes seizure identification via manual inspections performed by highly-trained experts a tedious endeavor, motivating the use of automated identification. The literature on automated identification focuses mostly on supervised learning methods requiring expert labels of EEG segments that contain seizures, which are difficult to obtain. Motivated by these observations, we pose seizure identification as an unsupervised anomaly detection problem. To this end, we employ the first unsupervised transformer-based model for seizure identification on raw EEG. We train an autoencoder involving a transformer encoder via an unsupervised loss function, incorporating a novel masking strategy uniquely designed for multivariate time-series data such as EEG. Training employs EEG recordings that do not contain any seizures, while seizures are identified with respect to reconstruction errors at inference time. We evaluate our method on three publicly available benchmark EEG datasets for distinguishing seizure vs. non-seizure windows. Our method leads to significantly better seizure identification performance than supervised learning counterparts, by up to 16% recall, 9% accuracy, and 9% Area under the Receiver Operating Characteristics Curve (AUC), establishing particular benefits on highly imbalanced data. Through accurate seizure identification, our method could facilitate widely accessible and early detection of epilepsy development, without needing expensive label collection or manual feature extraction.

📄 PDF Abstract BibTeX arXiv:2301.03470

Code (1)

ilkyyldz95/eeg_mvts 공식 구현 pytorch

Tasks

Anomaly DetectionEEGElectroencephalogram (EEG)Time SeriesTime Series AnalysisUnsupervised Anomaly Detection

Similar Papers 제목 키워드 기반

Temporal Graph Convolutional Networks for Automatic Seizure Detection

2019-05-03 · Ian Covert, Balu Krishnan, Imad Najm, Jiening Zhan 외

Seizure detection from EEGs is a challenging and time consuming clinical problem that would benefit from the development of automated algorithms. EEGs can be viewed as structural time series, because they are multivariat…

Inductive BiasSeizure DetectionTime SeriesTime Series Analysis

A Transformer-based Framework for Multivariate Time Series Representation Learning

2020-10-06 · George Zerveas, Srideepika Jayaraman, Dhaval Patel, Anuradha Bhamidipaty 외

In this work we propose for the first time a transformer-based framework for unsupervised representation learning of multivariate time series. Pre-trained models can be potentially used for downstream tasks such as regre…

Computational EfficiencyGeneral ClassificationImputationregression+6

Ymir: A Supervised Ensemble Framework for Multivariate Time Series Anomaly Detection

2021-12-09 · Zhanxiang Zhao

We proposed a multivariate time series anomaly detection frame-work Ymir, which leverages ensemble learning and supervisedlearning technology to efficiently learn and adapt to anomaliesin real-world system applications. …

Anomaly DetectionEnsemble LearningTime SeriesTime Series Analysis+2

Using Pre-trained LLMs for Multivariate Time Series Forecasting

2025-01-10 · Malcolm L. Wolff, Shenghao Yang, Kari Torkkola, Michael W. Mahoney

Pre-trained Large Language Models (LLMs) encapsulate large amounts of knowledge and take enormous amounts of compute to train. We make use of this resource, together with the observation that LLMs are able to transfer kn…

DecoderMultivariate Time Series ForecastingTime SeriesTime Series Forecasting

Multivariate Time-Series Anomaly Detection based on Enhancing Graph Attention Networks with Topological Analysis

2024-08-23 · Zhe Liu, Xiang Huang, Jingyun Zhang, Zhifeng Hao 외

Unsupervised anomaly detection in time series is essential in industrial applications, as it significantly reduces the need for manual intervention. Multivariate time series pose a complex challenge due to their feature …

Anomaly DetectionGraph AttentionTime SeriesTime Series Anomaly Detection+1