paper-with-me

홈 › Papers

Contrastive Unpaired Translation using Focal Loss for Patch Classification

2021-09-25 · Bernard Spiegl

Image-to-image translation models transfer images from input domain to output domain in an endeavor to retain the original content of the image. Contrastive Unpaired Translation is one of the existing methods for solving such problems. Significant advantage of this method, compared to competitors, is the ability to train and perform well in cases where both input and output domains are only a single image. Another key thing that differentiates this method from its predecessors is the usage of image patches rather than the whole images. It also turns out that sampling negatives (patches required to calculate the loss) from the same image achieves better results than a scenario where the negatives are sampled from other images in the dataset. This type of approach encourages mapping of corresponding patches to the same location in relation to other patches (negatives) while at the same time improves the output image quality and significantly decreases memory usage as well as the time required to train the model compared to CycleGAN method used as a baseline. Through a series of experiments we show that using focal loss in place of cross-entropy loss within the PatchNCE loss can improve on the model's performance and even surpass the current state-of-the-art model for image-to-image translation.

📄 PDF Abstract BibTeX arXiv:2109.12431

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationImage-to-Image TranslationTranslation

Methods 이 논문이 사용한 방법론

Batch Normalization 설명 없음
Residual Connection 설명 없음
Instance Normalization Instance Normalization (also known as contrast normalization) is a normalization layer where: $$ y_{tijk} = \frac{x_{tijk} - \mu_{ti}}{\sqrt{\sigma_{ti}^2 +…
Residual Block Residual Blocks are skip-connection blocks that learn residual functions with reference to the layer inputs, instead of learning unreferenced functions. They were introduced…
Sigmoid Activation 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Focal Loss A Focal Loss function addresses class imbalance during training in tasks like object detection. Focal loss applies a modulating term to the cross entropy loss in order to…
Tanh Activation 설명 없음

Similar Papers 제목 키워드 기반

Exploring Negatives in Contrastive Learning for Unpaired Image-to-Image Translation

2022-04-23 · Yupei Lin, Sen Zhang, Tianshui Chen, Yongyi Lu 외

Unpaired image-to-image translation aims to find a mapping between the source domain and the target domain. To alleviate the problem of the lack of supervised labels for the source images, cycle-consistency based methods…

Contrastive LearningImage-to-Image TranslationTranslation

Instance-wise Hard Negative Example Generation for Contrastive Learning in Unpaired Image-to-Image Translation

2021-08-10 · ICCV 2021 10 · Weilun Wang, Wengang Zhou, Jianmin Bao, Dong Chen 외

Contrastive learning shows great potential in unpaired image-to-image translation, but sometimes the translated results are in poor quality and the contents are not preserved consistently. In this paper, we uncover that …

Contrastive LearningImage-to-Image TranslationTranslation

Contrastive Learning for Unpaired Image-to-Image Translation

2020-07-30 · Taesung Park, Alexei A. Efros, Richard Zhang, Jun-Yan Zhu

In image-to-image translation, each patch in the output should reflect the content of the corresponding patch in the input, independent of domain. We propose a straightforward method for doing so -- maximizing mutual inf…

Contrastive LearningImage GenerationImage-to-Image TranslationTranslation

Contrastive Learning for Unpaired Image-to-Image Translation

2020-08-01 · ECCV 2020 8 · Taesung Park Alexei A. Efros Richard Zhang Jun-Yan Zhu

In image-to-image translation, each patch in the output should reflect the content of the corresponding patch in the input, independent of domain. We propose a straightforward method for doing so -- maximizing mutual inf…

Contrastive LearningImage GenerationImage-to-Image TranslationTranslation

Dual Contrastive Learning for Unsupervised Image-to-Image Translation

2021-04-15 · Junlin Han, Mehrdad Shoeiby, Lars Petersson, Mohammad Ali Armin

Unsupervised image-to-image translation tasks aim to find a mapping between a source domain X and a target domain Y from unpaired training data. Contrastive learning for Unpaired image-to-image Translation (CUT) yields s…

Contrastive LearningImage-to-Image TranslationTranslationUnsupervised Image-To-Image Translation