paper-with-me

홈 › Papers

SPD domain-specific batch normalization to crack interpretable unsupervised domain adaptation in EEG

2022-06-02 · Reinmar J Kobler, Jun-Ichiro Hirayama, Qibin Zhao, Motoaki Kawanabe

Electroencephalography (EEG) provides access to neuronal dynamics non-invasively with millisecond resolution, rendering it a viable method in neuroscience and healthcare. However, its utility is limited as current EEG technology does not generalize well across domains (i.e., sessions and subjects) without expensive supervised re-calibration. Contemporary methods cast this transfer learning (TL) problem as a multi-source/-target unsupervised domain adaptation (UDA) problem and address it with deep learning or shallow, Riemannian geometry aware alignment methods. Both directions have, so far, failed to consistently close the performance gap to state-of-the-art domain-specific methods based on tangent space mapping (TSM) on the symmetric positive definite (SPD) manifold. Here, we propose a theory-based machine learning framework that enables, for the first time, learning domain-invariant TSM models in an end-to-end fashion. To achieve this, we propose a new building block for geometric deep learning, which we denote SPD domain-specific momentum batch normalization (SPDDSMBN). A SPDDSMBN layer can transform domain-specific SPD inputs into domain-invariant SPD outputs, and can be readily applied to multi-source/-target and online UDA scenarios. In extensive experiments with 6 diverse EEG brain-computer interface (BCI) datasets, we obtain state-of-the-art performance in inter-session and -subject TL with a simple, intrinsically interpretable network architecture, which we denote TSMNet.

📄 PDF Abstract BibTeX arXiv:2206.01323

Code (1)

rkobler/TSMNet 공식 구현 pytorch

Tasks

Brain Computer InterfaceDomain AdaptationEEGElectroencephalogram (EEG)Transfer LearningUnsupervised Domain Adaptation

Methods 이 논문이 사용한 방법론

Batch Normalization 설명 없음
AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…

Similar Papers 제목 키워드 기반

Domain-Specific Batch Normalization for Unsupervised Domain Adaptation

2019-05-27 · CVPR 2019 6 · Woong-Gi Chang, Tackgeun You, Seonguk Seo, Suha Kwak 외

We propose a novel unsupervised domain adaptation framework based on domain-specific batch normalization in deep neural networks. We aim to adapt to both domains by specializing batch normalization layers in convolutiona…

Domain AdaptationUnsupervised Domain Adaptation

An Empirical Study of Batch Normalization and Group Normalization in Conditional Computation

2019-07-31 · Vincent Michalski, Vikram Voleti, Samira Ebrahimi Kahou, Anthony Ortiz 외

Batch normalization has been widely used to improve optimization in deep neural networks. While the uncertainty in batch statistics can act as a regularizer, using these dataset statistics specific to the training set im…

Conditional Image GenerationFew-Shot LearningImage GenerationQuestion Answering+2

Optimize TSK Fuzzy Systems for Classification Problems: Mini-Batch Gradient Descent with Uniform Regularization and Batch Normalization

2019-08-01 · Yuqi Cui, Jian Huang, Dongrui Wu

Takagi-Sugeno-Kang (TSK) fuzzy systems are flexible and interpretable machine learning models; however, they may not be easily optimized when the data size is large, and/or the data dimensionality is high. This paper pro…

General ClassificationInterpretable Machine Learning

Invariant Batch Normalization for Multi-source Domain Generalization

2021-01-01 · Qing Lian, LIN Yong, Tong Zhang

We consider the domain generalization problem, where the test domain differs from the training domain. For deep neural networks, we show that the batch normalization layer is a highly unstable component under such domain…

Domain Generalization

CrackUDA: Incremental Unsupervised Domain Adaptation for Improved Crack Segmentation in Civil Structures

2024-12-20 · Kushagra Srivastava, Damodar Datta Kancharla, Rizvi Tahereen, Pradeep Kumar Ramancharla 외

Crack segmentation plays a crucial role in ensuring the structural integrity and seismic safety of civil structures. However, existing crack segmentation algorithms encounter challenges in maintaining accuracy with domai…

Crack SegmentationDomain AdaptationSegmentationUnsupervised Domain Adaptation