paper-with-me

홈 › Papers

Variational Interaction Information Maximization for Cross-domain Disentanglement

2020-12-08 · NeurIPS 2020 12 · HyeongJoo Hwang, Geon-Hyeong Kim, Seunghoon Hong, Kee-Eung Kim

Cross-domain disentanglement is the problem of learning representations partitioned into domain-invariant and domain-specific representations, which is a key to successful domain transfer or measuring semantic distance between two domains. Grounded in information theory, we cast the simultaneous learning of domain-invariant and domain-specific representations as a joint objective of multiple information constraints, which does not require adversarial training or gradient reversal layers. We derive a tractable bound of the objective and propose a generative model named Interaction Information Auto-Encoder (IIAE). Our approach reveals insights on the desirable representation for cross-domain disentanglement and its connection to Variational Auto-Encoder (VAE). We demonstrate the validity of our model in the image-to-image translation and the cross-domain retrieval tasks. We further show that our model achieves the state-of-the-art performance in the zero-shot sketch based image retrieval task, even without external knowledge. Our implementation is publicly available at: https://github.com/gr8joo/IIAE

📄 PDF Abstract BibTeX arXiv:2012.04251

Code (2)

gr8joo/IIAE 공식 구현 tf
hanq0212/IIAE-Pytorch pytorch

Tasks

DisentanglementImage RetrievalImage-to-Image TranslationRetrievalSketch-Based Image RetrievalTranslation

Similar Papers 제목 키워드 기반

Information Maximization via Variational Autoencoders for Cross-Domain Recommendation

2024-05-31 · Xuying Ning, Wujiang Xu, Xiaolei Liu, Mingming Ha 외

Cross-Domain Sequential Recommendation (CDSR) methods aim to address the data sparsity and cold-start problems present in Single-Domain Sequential Recommendation (SDSR). Existing CDSR methods typically rely on overlappin…

DenoisingDisentanglementSequential Recommendation

Adversarial Mutual Information for Text Generation

2020-06-30 · ICML 2020 1 · Boyuan Pan, Yazheng Yang, Kaizhao Liang, Bhavya Kailkhura 외

Recent advances in maximizing mutual information (MI) between the source and target have demonstrated its effectiveness in text generation. However, previous works paid little attention to modeling the backward network o…

Text Generation

Pareto-frontier Entropy Search with Variational Lower Bound Maximization

2025-01-31 · Masanori Ishikura, Masayuki Karasuyama

This study considers multi-objective Bayesian optimization (MOBO) through the information gain of the Pareto-frontier. To calculate the information gain, a predictive distribution conditioned on the Pareto-frontier plays…

Bayesian Optimization

Variational Information Bottleneck on Vector Quantized Autoencoders

2018-08-02 · Hanwei Wu, Markus Flierl

In this paper, we provide an information-theoretic interpretation of the Vector Quantized-Variational Autoencoder (VQ-VAE). We show that the loss function of the original VQ-VAE can be derived from the variational determ…

VMI-VAE: Variational Mutual Information Maximization Framework for VAE With Discrete and Continuous Priors

2020-05-28 · Andriy Serdega, Dae-shik Kim

Variational Autoencoder is a scalable method for learning latent variable models of complex data. It employs a clear objective that can be easily optimized. However, it does not explicitly measure the quality of learned …