paper-with-me

홈 › Papers

End-to-end learnable EEG channel selection for deep neural networks with Gumbel-softmax

2021-02-11 · Thomas Strypsteen, Alexander Bertrand

Many electroencephalography (EEG) applications rely on channel selection methods to remove the least informative channels, e.g., to reduce the amount of electrodes to be mounted, to decrease the computational load, or to reduce overfitting effects and improve performance. Wrapper-based channel selection methods aim to match the channel selection step to the target model, yet they require to re-train the model multiple times on different candidate channel subsets, which often leads to an unacceptably high computational cost, especially when said model is a (deep) neural network. To alleviate this, we propose a framework to embed the EEG channel selection in the neural network itself to jointly learn the network weights and optimal channels in an end-to-end manner by traditional backpropagation algorithms. We deal with the discrete nature of this new optimization problem by employing continuous relaxations of the discrete channel selection parameters based on the Gumbel-softmax trick. We also propose a regularization method that discourages selecting channels more than once. This generic approach is evaluated on two different EEG tasks: motor imagery brain-computer interfaces and auditory attention decoding. The results demonstrate that our framework is generally applicable, while being competitive with state-of-the art EEG channel selection methods, tailored to these tasks.

📄 PDF Abstract BibTeX arXiv:2102.09050

Code (0)

등록된 구현이 없습니다.

Tasks

channel selectionEEGElectroencephalogram (EEG)Motor Imagery

Similar Papers 제목 키워드 기반

Conditional Gumbel-Softmax for constrained feature selection with application to node selection in wireless sensor networks

2024-06-03 · Thomas Strypsteen, Alexander Bertrand

In this paper, we introduce Conditional Gumbel-Softmax as a method to perform end-to-end learning of the optimal feature subset for a given task and deep neural network (DNN) model, while adhering to certain pairwise con…

EEGfeature selection

Gumbel-Softmax Selective Networks

2022-11-19 · Mahmoud Salem, Mohamed Osama Ahmed, Frederick Tung, Gabriel Oliveira

ML models often operate within the context of a larger system that can adapt its response when the ML model is uncertain, such as falling back on safe defaults or a human in the loop. This commonly encountered operationa…

Channel selection using Gumbel Softmax

2018-12-11 · ECCV 2020 8 · Charles Herrmann, Richard Strong Bowen, Ramin Zabih

Important applications such as mobile computing require reducing the computational costs of neural network inference. Ideally, applications would specify their preferred tradeoff between accuracy and speed, and the netwo…

channel selectionClassificationGeneral Classification

Gradient Estimation with Stochastic Softmax Tricks

2020-06-15 · NeurIPS 2020 12 · Max B. Paulus, Dami Choi, Daniel Tarlow, Andreas Krause 외

The Gumbel-Max trick is the basis of many relaxed gradient estimators. These estimators are easy to implement and low variance, but the goal of scaling them comprehensively to large combinatorial distributions is still o…

Indirectly Parameterized Concrete Autoencoders

2024-03-01 · Alfred Nilsson, Klas Wijk, Sai Bharath Chandra Gutha, Erik Englesson 외

Feature selection is a crucial task in settings where data is high-dimensional or acquiring the full set of features is costly. Recent developments in neural network-based embedded feature selection show promising result…

Decoderfeature selection