paper-with-me

Papers

Unsupervised Discovery, Control, and Disentanglement of Semantic Attributes with Applications to Anomaly Detection

2020-02-25 · William Paul, I-Jeng Wang, Fady Alajaji, Philippe Burlina

Our work focuses on unsupervised and generative methods that address the following goals: (a) learning unsupervised generative representations that discover latent factors controlling image semantic attributes, (b) studying how this ability to control attributes formally relates to the issue of latent factor disentanglement, clarifying related but dissimilar concepts that had been confounded in the past, and (c) developing anomaly detection methods that leverage representations learned in (a). For (a), we propose a network architecture that exploits the combination of multiscale generative models with mutual information (MI) maximization. For (b), we derive an analytical result (Lemma 1) that brings clarity to two related but distinct concepts: the ability of generative networks to control semantic attributes of images they generate, resulting from MI maximization, and the ability to disentangle latent space representations, obtained via total correlation minimization. More specifically, we demonstrate that maximizing semantic attribute control encourages disentanglement of latent factors. Using Lemma 1 and adopting MI in our loss function, we then show empirically that, for image generation tasks, the proposed approach exhibits superior performance as measured in the quality and disentanglement trade space, when compared to other state of the art methods, with quality assessed via the Frechet Inception Distance (FID), and disentanglement via mutual information gap. For (c), we design several systems for anomaly detection exploiting representations learned in (a), and demonstrate their performance benefits when compared to state-of-the-art generative and discriminative algorithms. The above contributions in representation learning have potential applications in addressing other important problems in computer vision, such as bias and privacy in AI.

📄 PDF Abstract BibTeX arXiv:2002.11169

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionAttributeDisentanglementImage GenerationLEMMARepresentation LearningStyle Transfer

Similar Papers 제목 키워드 기반

U-Face: An Efficient and Generalizable Framework for Unsupervised Facial Attribute Editing via Subspace Learning

2026-03-14 · Bo Liu, Xuan Cui, Run Zeng, Wei Duan 외 arxiv

Latent space-based facial attribute editing methods have gained popularity in applications such as digital entertainment, virtual avatar creation, and human-computer interaction systems due to their potential for efficie…

Representation Learning

Evaluation of Latent Space Disentanglement in the Presence of Interdependent Attributes

2021-10-11 · Karn N. Watcharasupat, Alexander Lerch

Controllable music generation with deep generative models has become increasingly reliant on disentanglement learning techniques. However, current disentanglement metrics, such as mutual information gap (MIG), are often …

DisentanglementMusic Generation

DisCont: Self-Supervised Visual Attribute Disentanglement using Context Vectors

2020-06-10 · Sarthak Bhagat, Vishaal Udandarao, Shagun Uppal

Disentangling the underlying feature attributes within an image with no prior supervision is a challenging task. Models that can disentangle attributes well provide greater interpretability and control. In this paper, we…

AttributeContrastive LearningDisentanglement

Multi-Attribute Balanced Sampling for Disentangled GAN Controls

2021-10-28 · Perla Doubinsky, Nicolas Audebert, Michel Crucianu, Hervé Le Borgne

Various controls over the generated data can be extracted from the latent space of a pre-trained GAN, as it implicitly encodes the semantics of the training data. The discovered controls allow to vary semantic attributes…

AttributeDisentanglement

Exploring Gradient-based Multi-directional Controls in GANs

2022-09-01 · Zikun Chen, Ruowei Jiang, Brendan Duke, Han Zhao 외

Generative Adversarial Networks (GANs) have been widely applied in modeling diverse image distributions. However, despite its impressive applications, the structure of the latent space in GANs largely remains as a black-…

AttributeDisentanglementNavigate