Langevin Cooling for Domain Translation
Domain translation is the task of finding correspondence between two domains. Several Deep Neural Network (DNN) models, e.g., CycleGAN and cross-lingual language models, have shown remarkable successes on this task under the unsupervised setting---the mappings between the domains are learned from two independent sets of training data in both domains (without paired samples). However, those methods typically do not perform well on a significant proportion of test samples. In this paper, we hypothesize that many of such unsuccessful samples lie at the fringe---relatively low-density areas---of data distribution, where the DNN was not trained very well, and propose to perform Langevin dynamics to bring such fringe samples towards high density areas. We demonstrate qualitatively and quantitatively that our strategy, called Langevin Cooling (L-Cool), enhances state-of-the-art methods in image translation and language translation tasks.
Code (1)
Tasks
TranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
CoolMomentum: A Method for Stochastic Optimization by Langevin Dynamics with Simulated Annealing
Deep learning applications require global optimization of non-convex objective functions, which have multiple local minima. The same problem is often found in physical simulations and may be resolved by the methods of La…
global-optimizationPhysical SimulationsStochastic OptimizationUnityDC-MBR: Distributional Cooling for Minimum Bayesian Risk Decoding
Minimum Bayesian Risk Decoding (MBR) emerges as a promising decoding algorithm in Neural Machine Translation. However, MBR performs poorly with label smoothing, which is surprising as label smoothing provides decent impr…
Machine TranslationNMTUNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Models
We propose a novel unpaired image-to-image translation method that uses denoising diffusion probabilistic models without requiring adversarial training. Our method, UNpaired Image Translation with Denoising Diffusion Pro…
DenoisingImage-to-Image TranslationTranslationLearning Cycle-Consistent Cooperative Networks via Alternating MCMC Teaching for Unsupervised Cross-Domain Translation
This paper studies the unsupervised cross-domain translation problem by proposing a generative framework, in which the probability distribution of each domain is represented by a generative cooperative network that consi…
DecoderImage-to-Image TranslationTranslationUnsupervised Image-To-Image TranslationIndia's residential space cooling transition: Decarbonization ambitions since the turn of millennium
As an emerging emitter poised for significant growth in space cooling demand, India requires comprehensive insights into historical emission trends and decarbonization performance to shape future low-carbon cooling strat…