paper-with-me

Papers

Learning Cycle-Consistent Cooperative Networks via Alternating MCMC Teaching for Unsupervised Cross-Domain Translation

2021-03-07 · Jianwen Xie, Zilong Zheng, Xiaolin Fang, Song-Chun Zhu, Ying Nian Wu

This paper studies the unsupervised cross-domain translation problem by proposing a generative framework, in which the probability distribution of each domain is represented by a generative cooperative network that consists of an energy-based model and a latent variable model. The use of generative cooperative network enables maximum likelihood learning of the domain model by MCMC teaching, where the energy-based model seeks to fit the data distribution of domain and distills its knowledge to the latent variable model via MCMC. Specifically, in the MCMC teaching process, the latent variable model parameterized by an encoder-decoder maps examples from the source domain to the target domain, while the energy-based model further refines the mapped results by Langevin revision such that the revised results match to the examples in the target domain in terms of the statistical properties, which are defined by the learned energy function. For the purpose of building up a correspondence between two unpaired domains, the proposed framework simultaneously learns a pair of cooperative networks with cycle consistency, accounting for a two-way translation between two domains, by alternating MCMC teaching. Experiments show that the proposed framework is useful for unsupervised image-to-image translation and unpaired image sequence translation.

📄 PDF Abstract BibTeX arXiv:2103.04285

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderImage-to-Image TranslationTranslationUnsupervised Image-To-Image Translation

Similar Papers 제목 키워드 기반

Cooperative Training of Descriptor and Generator Networks

2016-09-29 · Jianwen Xie, Yang Lu, Ruiqi Gao, Song-Chun Zhu 외

This paper studies the cooperative training of two generative models for image modeling and synthesis. Both models are parametrized by convolutional neural networks (ConvNets). The first model is a deep energy-based mode…

Learning Energy-Based Model with Variational Auto-Encoder as Amortized Sampler

2020-12-29 · Jianwen Xie, Zilong Zheng, Ping Li

Due to the intractable partition function, training energy-based models (EBMs) by maximum likelihood requires Markov chain Monte Carlo (MCMC) sampling to approximate the gradient of the Kullback-Leibler divergence betwee…

Learning Energy-based Model via Dual-MCMC Teaching

2023-12-05 · NeurIPS 2023 11 · Jiali Cui, Tian Han

This paper studies the fundamental learning problem of the energy-based model (EBM). Learning the EBM can be achieved using the maximum likelihood estimation (MLE), which typically involves the Markov Chain Monte Carlo (…

Image Generation

CoopInit: Initializing Generative Adversarial Networks via Cooperative Learning

2023-03-21 · Yang Zhao, Jianwen Xie, Ping Li

Numerous research efforts have been made to stabilize the training of the Generative Adversarial Networks (GANs), such as through regularization and architecture design. However, we identify the instability can also aris…

Image GenerationImage-to-Image Translation

CoopHash: Cooperative Learning of Multipurpose Descriptor and Contrastive Pair Generator via Variational MCMC Teaching for Supervised Image Hashing

2022-10-09 · Khoa D. Doan, Jianwen Xie, Yaxuan Zhu, Yang Zhao 외

Leveraging supervised information can lead to superior retrieval performance in the image hashing domain but the performance degrades significantly without enough labeled data. One effective solution to boost performance…

Retrieval