paper-with-me

홈 › Papers

Physics-Based Generative Adversarial Models for Image Restoration and Beyond

2018-08-02 · Jinshan Pan, Jiangxin Dong, Yang Liu, Jiawei Zhang, Jimmy Ren, Jinhui Tang, Yu-Wing Tai, Ming-Hsuan Yang

We present an algorithm to directly solve numerous image restoration problems (e.g., image deblurring, image dehazing, image deraining, etc.). These problems are highly ill-posed, and the common assumptions for existing methods are usually based on heuristic image priors. In this paper, we find that these problems can be solved by generative models with adversarial learning. However, the basic formulation of generative adversarial networks (GANs) does not generate realistic images, and some structures of the estimated images are usually not preserved well. Motivated by an interesting observation that the estimated results should be consistent with the observed inputs under the physics models, we propose a physics model constrained learning algorithm so that it can guide the estimation of the specific task in the conventional GAN framework. The proposed algorithm is trained in an end-to-end fashion and can be applied to a variety of image restoration and related low-level vision problems. Extensive experiments demonstrate that our method performs favorably against the state-of-the-art algorithms.

📄 PDF Abstract BibTeX arXiv:1808.00605

Code (0)

등록된 구현이 없습니다.

Tasks

DeblurringImage DeblurringImage DehazingImage RestorationRain Removal

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dogecoin Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

GLEAN: Generative Latent Bank for Image Super-Resolution and Beyond

2022-07-29 · Kelvin C. K. Chan, Xiangyu Xu, Xintao Wang, Jinwei Gu 외

We show that pre-trained Generative Adversarial Networks (GANs) such as StyleGAN and BigGAN can be used as a latent bank to improve the performance of image super-resolution. While most existing perceptual-oriented appro…

ColorizationDecoderImage ColorizationImage Restoration+2

HybrUR: A Hybrid Physical-Neural Solution for Unsupervised Underwater Image Restoration

2021-07-06 · Shuaizheng Yan, Xingyu Chen, Zhengxing Wu, Min Tan 외

Robust vision restoration of underwater images remains a challenge. Owing to the lack of well-matched underwater and in-air images, unsupervised methods based on the cyclic generative adversarial framework have been wide…

Image RestorationUnderwater Image Restoration

Physics-Constrained Generative Adversarial Networks for 3D Turbulence

2022-12-01 · Dima Tretiak, Arvind T. Mohan, Daniel Livescu

Generative Adversarial Networks (GANs) have received wide acclaim among the machine learning (ML) community for their ability to generate realistic 2D images. ML is being applied more often to complex problems beyond tho…

GLEAN: Generative Latent Bank for Large-Factor Image Super-Resolution

2020-12-01 · CVPR 2021 1 · Kelvin C. K. Chan, Xintao Wang, Xiangyu Xu, Jinwei Gu 외

We show that pre-trained Generative Adversarial Networks (GANs), e.g., StyleGAN, can be used as a latent bank to improve the restoration quality of large-factor image super-resolution (SR). While most existing SR approac…

DecoderImage Super-ResolutionSuper-Resolution

Rethinking Generative Methods for Image Restoration in Physics-based Vision: A Theoretical Analysis from the Perspective of Information

2022-12-05 · Xudong Kang, Haoran Xie, Man-Leung Wong, Jing Qin

End-to-end generative methods are considered a more promising solution for image restoration in physics-based vision compared with the traditional deconstructive methods based on handcrafted composition models. However, …

Image Restoration