Learning the Loss Functions in a Discriminative Space for Video Restoration
With more advanced deep network architectures and learning schemes such as GANs, the performance of video restoration algorithms has greatly improved recently. Meanwhile, the loss functions for optimizing deep neural networks remain relatively unchanged. To this end, we propose a new framework for building effective loss functions by learning a discriminative space specific to a video restoration task. Our framework is similar to GANs in that we iteratively train two networks - a generator and a loss network. The generator learns to restore videos in a supervised fashion, by following ground truth features through the feature matching in the discriminative space learned by the loss network. In addition, we also introduce a new relation loss in order to maintain the temporal consistency in output videos. Experiments on video superresolution and deblurring show that our method generates visually more pleasing videos with better quantitative perceptual metric values than the other state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
DeblurringVideo RestorationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Unlocking Masked Autoencoders as Loss Function for Image and Video Restoration
Image and video restoration has achieved a remarkable leap with the advent of deep learning. The success of deep learning paradigm lies in three key components: data, model, and loss. Currently, many efforts have been de…
DenoisingImage DenoisingImage EnhancementImage Super-Resolution+4Toward Accurate and Temporally Consistent Video Restoration from Raw Data
Denoising and demosaicking are two fundamental steps in reconstructing a clean full-color video from raw data, while performing video denoising and demosaicking jointly, namely VJDD, could lead to better video restoratio…
DemosaickingDenoisingVideo DenoisingVideo RestorationUnsupervised Methods for Video Quality Improvement: A Survey of Restoration and Enhancement Techniques
Video restoration and enhancement are critical not only for improving visual quality, but also as essential pre-processing steps to boost the performance of a wide range of downstream computer vision tasks. This survey p…
Video RestorationTraining Neural Networks on RAW and HDR Images for Restoration Tasks
The vast majority of standard image and video content available online is represented in display-encoded color spaces, in which pixel values are conveniently scaled to a limited range (0-1) and the color distribution is …
DeblurringDenoisingImage RestorationImage Super-Resolution+1Deep Discriminative Spatial and Temporal Network for Efficient Video Deblurring
How to effectively explore spatial and temporal information is important for video deblurring. In contrast to existing methods that directly align adjacent frames without discrimination, we develop a deep discriminat…
DeblurringVideo Deblurring