paper-with-me

홈 › Papers

ScatterFormer: Locally-Invariant Scattering Transformer for Patient-Independent Multispectral Detection of Epileptiform Discharges

2023-04-26 · Ruizhe Zheng, Jun Li, Yi Wang, Tian Luo, Yuguo Yu

Patient-independent detection of epileptic activities based on visual spectral representation of continuous EEG (cEEG) has been widely used for diagnosing epilepsy. However, precise detection remains a considerable challenge due to subtle variabilities across subjects, channels and time points. Thus, capturing fine-grained, discriminative features of EEG patterns, which is associated with high-frequency textural information, is yet to be resolved. In this work, we propose Scattering Transformer (ScatterFormer), an invariant scattering transform-based hierarchical Transformer that specifically pays attention to subtle features. In particular, the disentangled frequency-aware attention (FAA) enables the Transformer to capture clinically informative high-frequency components, offering a novel clinical explainability based on visual encoding of multichannel EEG signals. Evaluations on two distinct tasks of epileptiform detection demonstrate the effectiveness our method. Our proposed model achieves median AUCROC and accuracy of 98.14%, 96.39% in patients with Rolandic epilepsy. On a neonatal seizure detection benchmark, it outperforms the state-of-the-art by 9% in terms of average AUCROC.

📄 PDF Abstract BibTeX arXiv:2304.14919

Code (1)

albertcheng19/scatterformer 공식 구현 pytorch

Tasks

EEGSeizure Detection

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

ScatterFormer: Efficient Voxel Transformer with Scattered Linear Attention

2024-01-01 · Chenhang He, Ruihuang Li, Guowen Zhang, Lei Zhang

Window-based transformers excel in large-scale point cloud understanding by capturing context-aware representations with affordable attention computation in a more localized manner. However, the sparse nature of point cl…

Blocking

A Learnable ScatterNet: Locally Invariant Convolutional Layers

2019-03-07 · Fergal Cotter, Nick Kingsbury

In this paper we explore tying together the ideas from Scattering Transforms and Convolutional Neural Networks (CNN) for Image Analysis by proposing a learnable ScatterNet. Previous attempts at tying them together in hyb…

Classification with Scattering Operators

2010-11-12 · Joan Bruna, Stéphane Mallat

A scattering vector is a local descriptor including multiscale and multi-direction co-occurrence information. It is computed with a cascade of wavelet decompositions and complex modulus. This scattering representation is…

ClassificationGeneral ClassificationHandwritten Digit RecognitionModel Selection+2

Multi-Resolution Dual-Tree Wavelet Scattering Network for Signal Classification

2017-02-10 · Amarjot Singh, Nick Kingsbury

This paper introduces a Deep Scattering network that utilizes Dual-Tree complex wavelets to extract translation invariant representations from an input signal. The computationally efficient Dual-Tree wavelets decompose t…

ClassificationGeneral ClassificationTranslation

Robust Unsupervised Transient Detection With Invariant Representation based on the Scattering Network

2016-11-23 · Randall Balestriero, Behnaam Aazhang

We present a sparse and invariant representation with low asymptotic complexity for robust unsupervised transient and onset zone detection in noisy environments. This unsupervised approach is based on wavelet transforms …