paper-with-me

홈 › Papers

Bringing Old Photos Back to Life

2020-04-20 · CVPR 2020 6 · Zi-Yu Wan, Bo Zhang, Dong-Dong Chen, Pan Zhang, Dong Chen, Jing Liao, Fang Wen

We propose to restore old photos that suffer from severe degradation through a deep learning approach. Unlike conventional restoration tasks that can be solved through supervised learning, the degradation in real photos is complex and the domain gap between synthetic images and real old photos makes the network fail to generalize. Therefore, we propose a novel triplet domain translation network by leveraging real photos along with massive synthetic image pairs. Specifically, we train two variational autoencoders (VAEs) to respectively transform old photos and clean photos into two latent spaces. And the translation between these two latent spaces is learned with synthetic paired data. This translation generalizes well to real photos because the domain gap is closed in the compact latent space. Besides, to address multiple degradations mixed in one old photo, we design a global branch with a partial nonlocal block targeting to the structured defects, such as scratches and dust spots, and a local branch targeting to the unstructured defects, such as noises and blurriness. Two branches are fused in the latent space, leading to improved capability to restore old photos from multiple defects. The proposed method outperforms state-of-the-art methods in terms of visual quality for old photos restoration.

📄 PDF Abstract BibTeX arXiv:2004.09484

Code (7)

microsoft/Bringing-Old-Photos-Back-to-Life 공식 구현 pytorch
ImportPaddle/Old2Life paddle
Nero-Disney/MICROSOFT_Bringing-Old-Photos-Back-to-Life pytorch
Sang2710/Bringing-old-photos-back-to-life pytorch
random-zhang/Bringing-Old-Photos-Back-to-Life-master pytorch
shinde-Pratik/Image-Restoration pytorch
yasamin-niknam/Image-Restoration pytorch

Tasks

Image RestorationTranslationTriplet

Similar Papers 제목 키워드 기반

Generative Adversarial Talking Head: Bringing Portraits to Life with a Weakly Supervised Neural Network

2018-03-21 · Hai X. Pham, Yuting Wang, Vladimir Pavlovic

This paper presents Generative Adversarial Talking Head (GATH), a novel deep generative neural network that enables fully automatic facial expression synthesis of an arbitrary portrait with continuous action unit (AU) co…

Face Model

Bringing Old Films Back to Life

2022-03-31 · CVPR 2022 1 · Ziyu Wan, Bo Zhang, Dongdong Chen, Jing Liao

We present a learning-based framework, recurrent transformer network (RTN), to restore heavily degraded old films. Instead of performing frame-wise restoration, our method is based on the hidden knowledge learned from ad…

Analog Video Restoration

Web Photo Source Identification based on Neural Enhanced Camera Fingerprint

2023-02-18 · Feng Qian, Sifeng He, Honghao Huang, Huanyu Ma 외

With the growing popularity of smartphone photography in recent years, web photos play an increasingly important role in all walks of life. Source camera identification of web photos aims to establish a reliable linkage …

Metric Learning

Visual Summary of Egocentric Photostreams by Representative Keyframes

2015-05-05 · Marc Bolaños, Ricard Mestre, Estefanía Talavera, Xavier Giró-i-Nieto 외

Building a visual summary from an egocentric photostream captured by a lifelogging wearable camera is of high interest for different applications (e.g. memory reinforcement). In this paper, we propose a new summarization…

Clustering

Jurassic World Remake: Bringing Ancient Fossils Back to Life via Zero-Shot Long Image-to-Image Translation

2023-08-14 · Alexander Martin, Haitian Zheng, Jie An, Jiebo Luo

With a strong understanding of the target domain from natural language, we produce promising results in translating across large domain gaps and bringing skeletons back to life. In this work, we use text-guided latent di…

Image-to-Image Translation