paper-with-me

홈 › Papers

adVAE: A self-adversarial variational autoencoder with Gaussian anomaly prior knowledge for anomaly detection

2019-03-03 · Xuhong Wang, Ying Du, Shi-Jie Lin, Ping Cui, Yuntian Shen, Yupu Yang

Recently, deep generative models have become increasingly popular in unsupervised anomaly detection. However, deep generative models aim at recovering the data distribution rather than detecting anomalies. Besides, deep generative models have the risk of overfitting training samples, which has disastrous effects on anomaly detection performance. To solve the above two problems, we propose a Self-adversarial Variational Autoencoder with a Gaussian anomaly prior assumption. We assume that both the anomalous and the normal prior distribution are Gaussian and have overlaps in the latent space. Therefore, a Gaussian transformer net T is trained to synthesize anomalous but near-normal latent variables. Keeping the original training objective of Variational Autoencoder, besides, the generator G tries to distinguish between the normal latent variables and the anomalous ones synthesized by T, and the encoder E is trained to discriminate whether the output of G is real. These new objectives we added not only give both G and E the ability to discriminate but also introduce additional regularization to prevent overfitting. Compared with the SOTA baselines, the proposed model achieves significant improvements in extensive experiments. Datasets and our model are available at a Github repository.

📄 PDF Abstract BibTeX arXiv:1903.00904

Code (2)

WangXuhongCN/adVAE 공식 구현 pytorch
YeongHyeon/adVAE tf

Tasks

Anomaly DetectionUnsupervised Anomaly Detection

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Solana Customer Service Number +1-833-534-1729 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Interpretable Sentence Representation with Variational Autoencoders and Attention

2023-05-04 · Ghazi Felhi

In this thesis, we develop methods to enhance the interpretability of recent representation learning techniques in natural language processing (NLP) while accounting for the unavailability of annotated data. We choose to…

DisentanglementInductive BiasLanguage ModelingLanguage Modelling+2

Towards Unsupervised Content Disentanglement in Sentence Representations via Syntactic Roles

2022-06-22 · Ghazi Felhi, Joseph Le Roux, Djamé Seddah

Linking neural representations to linguistic factors is crucial in order to build and analyze NLP models interpretable by humans. Among these factors, syntactic roles (e.g. subjects, direct objects,$\dots$) and their rea…

DecoderDisentanglementMachine TranslationSentence

Biadversarial Variational Autoencoder

2019-02-09 · Arnaud Fickinger

In the original version of the Variational Autoencoder, Kingma et al. assume Gaussian distributions for the approximate posterior during the inference and for the output during the generative process. This assumptions ar…

Adversarial Jamming for Autoencoder Distribution Matching

2025-12-02 · Waleed El-Geresy, Deniz Gündüz arxiv

We propose the use of adversarial wireless jamming to regularise the latent space of an autoencoder to match a diagonal Gaussian distribution. We consider the minimisation of a mean squared error distortion, where a jamm…

Resisting Adversarial Attacks using Gaussian Mixture Variational Autoencoders

2018-05-31 · Partha Ghosh, Arpan Losalka, Michael J. Black

Susceptibility of deep neural networks to adversarial attacks poses a major theoretical and practical challenge. All efforts to harden classifiers against such attacks have seen limited success. Two distinct categories o…