paper-with-me

Papers

Recursive Disentanglement Network

2021-09-29 · ICLR 2022 4 · Yixuan Chen, Yubin Shi, Dongsheng Li, Yujiang Wang, Mingzhi Dong, Yingying Zhao, Robert Dick, Qin Lv, Fan Yang, Li Shang

Disentangled feature representation is essential for data-efficient learning. The feature space of deep models is inherently compositional. Existing $\beta$-VAE-based methods, which only apply disentanglement regularization to the resulting embedding space of deep models, cannot effectively regularize such compositional feature space, resulting in unsatisfactory disentangled results. In this paper, we formulate the compositional disentanglement learning problem from an information-theoretic perspective and propose a recursive disentanglement network (RecurD) that propagates regulatory inductive bias recursively across the compositional feature space during disentangled representation learning. Experimental studies demonstrate that RecurD outperforms $\beta$-VAE and several of its state-of-the-art variants on disentangled representation learning and enables more data-efficient downstream machine learning tasks.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

DisentanglementInductive BiasRepresentation Learning

Similar Papers 제목 키워드 기반

Robust Disentanglement of a Few Factors at a Time

2020-10-26 · NeurIPS 2020 12 · Benjamin Estermann, Markus Marks, Mehmet Fatih Yanik

Disentanglement is at the forefront of unsupervised learning, as disentangled representations of data improve generalization, interpretability, and performance in downstream tasks. Current unsupervised approaches remain …

Disentanglement

Latent Multi-Relation Reasoning for GAN-Prior based Image Super-Resolution

2022-08-04 · Jiahui Zhang, Fangneng Zhan, Yingchen Yu, Rongliang Wu 외

Recently, single image super-resolution (SR) under large scaling factors has witnessed impressive progress by introducing pre-trained generative adversarial networks (GANs) as priors. However, most GAN-Priors based SR me…

AttributeCode GenerationDisentanglementImage Super-Resolution+2

Variantional autoencoder with decremental information bottleneck for disentanglement

2023-03-22 · Jiantao Wu, Shentong Mo, Muhammad Awais, Sara Atito 외

One major challenge of disentanglement learning with variational autoencoders is the trade-off between disentanglement and reconstruction fidelity. Previous studies, which increase the information bottleneck during train…

DisentanglementRepresentation Learning

NeurIPS 2019 Disentanglement Challenge: Improved Disentanglement through Aggregated Convolutional Feature Maps

2020-02-23 · Maximilian Seitzer

This report to our stage 1 submission to the NeurIPS 2019 disentanglement challenge presents a simple image preprocessing method for training VAEs leading to improved disentanglement compared to directly using the images…

Disentanglement

Disentanglement in Difference: Directly Learning Semantically Disentangled Representations by Maximizing Inter-Factor Differences

2025-02-05 · Xingshen Zhang, Lin Wang, Shuangrong Liu, Xintao Lu 외

In this study, Disentanglement in Difference(DiD) is proposed to address the inherent inconsistency between the statistical independence of latent variables and the goal of semantic disentanglement in disentanglement rep…

DisentanglementRepresentation Learning