paper-with-me

Papers

Disentangled Representation Learning

2022-11-21 · Xin Wang, Hong Chen, Si'ao Tang, Zihao Wu, Wenwu Zhu

Disentangled Representation Learning (DRL) aims to learn a model capable of identifying and disentangling the underlying factors hidden in the observable data in representation form. The process of separating underlying factors of variation into variables with semantic meaning benefits in learning explainable representations of data, which imitates the meaningful understanding process of humans when observing an object or relation. As a general learning strategy, DRL has demonstrated its power in improving the model explainability, controlability, robustness, as well as generalization capacity in a wide range of scenarios such as computer vision, natural language processing, and data mining. In this article, we comprehensively investigate DRL from various aspects including motivations, definitions, methodologies, evaluations, applications, and model designs. We first present two well-recognized definitions, i.e., Intuitive Definition and Group Theory Definition for disentangled representation learning. We further categorize the methodologies for DRL into four groups from the following perspectives, the model type, representation structure, supervision signal, and independence assumption. We also analyze principles to design different DRL models that may benefit different tasks in practical applications. Finally, we point out challenges in DRL as well as potential research directions deserving future investigations. We believe this work may provide insights for promoting the DRL research in the community.

📄 PDF Abstract BibTeX arXiv:2211.11695

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

Gauge theory and twins paradox of disentangled representations

2019-06-24 · X. Dong, L. Zhou

Achieving disentangled representations of information is one of the key goals of deep network based machine learning system. Recently there are more discussions on this issue. In this paper, by comparing the geometric st…

BIG-bench Machine Learning

Learning Disentangled Representation by Exploiting Pretrained Generative Models: A Contrastive Learning View

2021-02-21 · ICLR 2022 4 · Xuanchi Ren, Tao Yang, Yuwang Wang, Wenjun Zeng

From the intuitive notion of disentanglement, the image variations corresponding to different factors should be distinct from each other, and the disentangled representation should reflect those variations with separate …

Contrastive LearningDisentanglementRepresentation Learning

C$^2$VAE: Gaussian Copula-based VAE Differing Disentangled from Coupled Representations with Contrastive Posterior

2023-09-23 · Zhangkai Wu, Longbing Cao

We present a self-supervised variational autoencoder (VAE) to jointly learn disentangled and dependent hidden factors and then enhance disentangled representation learning by a self-supervised classifier to eliminate cou…

Representation Learning

DualVAE: Dual Disentangled Variational AutoEncoder for Recommendation

2024-01-10 · Zhiqiang Guo, GuoHui Li, Jianjun Li, Chaoyang Wang 외

Learning precise representations of users and items to fit observed interaction data is the fundamental task of collaborative filtering. Existing studies usually infer entangled representations to fit such interaction da…

Collaborative FilteringDisentanglementRepresentation LearningVariational Inference

Towards Better Understanding of Disentangled Representations via Mutual Information

2019-11-25 · Xiaojiang Yang, Wendong Bi, Yitong Sun, Yu Cheng 외

Most existing works on disentangled representation learning are solely built upon an marginal independence assumption: all factors in disentangled representations should be statistically independent. This assumption is n…

DisentanglementInductive BiasRelationRepresentation Learning