Reversible GANs for Memory-efficient Image-to-Image Translation

2019-02-07 · CVPR 2019 6 · Tycho F. A. van der Ouderaa, Daniel E. Worrall

The Pix2pix and CycleGAN losses have vastly improved the qualitative and quantitative visual quality of results in image-to-image translation tasks. We extend this framework by exploring approximately invertible architectures which are well suited to these losses. These architectures are approximately invertible by design and thus partially satisfy cycle-consistency before training even begins. Furthermore, since invertible architectures have constant memory complexity in depth, these models can be built arbitrarily deep. We are able to demonstrate superior quantitative output on the Cityscapes and Maps datasets at near constant memory budget.

📄 PDF Abstract BibTeX arXiv:1902.02729

Code (3)

tychovdo/RevGAN 공식 구현 pytorch

ganslate-team/ganslate pytorch

silvandeleemput/memcnn pytorch

Tasks

Image-to-Image Translation Translation

Methods 이 논문이 사용한 방법론

Residual Connection 설명 없음

Tanh Activation 설명 없음

Residual Block Residual Blocks are skip-connection blocks that learn residual functions with reference to the layer inputs, instead of learning unreferenced functions. They were introduced…

Instance Normalization Instance Normalization (also known as contrast normalization) is a normalization layer where: $$ y_{tijk} = \frac{x_{tijk} - \mu_{ti}}{\sqrt{\sigma_{ti}^2 +…

GAN Least Squares Loss GAN Least Squares Loss is a least squares loss function for generative adversarial networks. Minimizing this objective function is equivalent to minimizing the Pearson…

Cycle Consistency Loss Cycle Consistency Loss is a type of loss used for generative adversarial networks that performs unpaired image-to-image translation. It was introduced with the…

Cardano Customer Service Number +1-833-534-1729 설명 없음

Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…

Memory-efficient GAN-based Domain Translation of High Resolution 3D Medical Images

2020-10-06 · Hristina Uzunova, Jan Ehrhardt, Heinz Handels

Generative adversarial networks (GANs) are currently rarely applied on 3D medical images of large size, due to their immense computational demand. The present work proposes a multi-scale patch-based GAN approach for esta…

GPU Image Generation Translation

Multi-split Reversible Transformers Can Enhance Neural Machine Translation

2021-04-01 · EACL 2021 2 · Yuekai Zhao, Shuchang Zhou, Zhihua Zhang

Large-scale transformers have been shown the state-of-the-art on neural machine translation. However, training these increasingly wider and deeper models could be tremendously memory intensive. We reduce the memory burde…

Machine Translation Translation

Refacing: reconstructing anonymized facial features using GANs

2018-10-15 · David Abramian, Anders Eklund

Anonymization of medical images is necessary for protecting the identity of the test subjects, and is therefore an essential step in data sharing. However, recent developments in deep learning may raise the bar on the am…

Image-to-Image Translation Translation Unsupervised Image-To-Image Translation

PPDM: Pixel Puzzling Diffusion Model for Speed and Memory Efficient Volumetric Medical Image Translation

2026-06-13 · Tianqi Chen, Jun Hou, Yinchi Zhou, James S. Duncan 외 arxiv

Diffusion models have demonstrated superior fidelity for medical image-to-image translation, but their extension to high-resolution 3D volumes is severely constrained by prohibitive computational cost and GPU memory requ…

Image-to-Image Translation

Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translation

2022-03-12 · CVPR 2022 1 · Linfeng Zhang, Xin Chen, Xiaobing Tu, Pengfei Wan 외

Remarkable achievements have been attained with Generative Adversarial Networks (GANs) in image-to-image translation. However, due to a tremendous amount of parameters, state-of-the-art GANs usually suffer from low effic…

Image-to-Image Translation Knowledge Distillation Translation