paper-with-me

홈 › Papers

Modernizing Old Photos Using Multiple References via Photorealistic Style Transfer

2023-04-10 · CVPR 2023 1 · Agus Gunawan, Soo Ye Kim, Hyeonjun Sim, Jae-Ho Lee, Munchurl Kim

This paper firstly presents old photo modernization using multiple references by performing stylization and enhancement in a unified manner. In order to modernize old photos, we propose a novel multi-reference-based old photo modernization (MROPM) framework consisting of a network MROPM-Net and a novel synthetic data generation scheme. MROPM-Net stylizes old photos using multiple references via photorealistic style transfer (PST) and further enhances the results to produce modern-looking images. Meanwhile, the synthetic data generation scheme trains the network to effectively utilize multiple references to perform modernization. To evaluate the performance, we propose a new old photos benchmark dataset (CHD) consisting of diverse natural indoor and outdoor scenes. Extensive experiments show that the proposed method outperforms other baselines in performing modernization on real old photos, even though no old photos were used during training. Moreover, our method can appropriately select styles from multiple references for each semantic region in the old photo to further improve the modernization performance.

📄 PDF Abstract BibTeX arXiv:2304.04461

Code (0)

등록된 구현이 없습니다.

Tasks

Style TransferSynthetic Data Generation

Similar Papers 제목 키워드 기반

A Closed-form Solution to Photorealistic Image Stylization

2018-02-19 · ECCV 2018 9 · Yijun Li, Ming-Yu Liu, Xueting Li, Ming-Hsuan Yang 외

Photorealistic image stylization concerns transferring style of a reference photo to a content photo with the constraint that the stylized photo should remain photorealistic. While several photorealistic image stylizatio…

FormImage Stylization

PhotoShape: Photorealistic Materials for Large-Scale Shape Collections

2018-09-26 · Keunhong Park, Konstantinos Rematas, Ali Farhadi, Steven M. Seitz

Existing online 3D shape repositories contain thousands of 3D models but lack photorealistic appearance. We present an approach to automatically assign high-quality, realistic appearance models to large scale 3D shape co…

Ref-NPR: Reference-Based Non-Photorealistic Radiance Fields for Controllable Scene Stylization

2022-12-06 · CVPR 2023 1 · Yuechen Zhang, Zexin He, Jinbo Xing, Xufeng Yao 외

Current 3D scene stylization methods transfer textures and colors as styles using arbitrary style references, lacking meaningful semantic correspondences. We introduce Reference-Based Non-Photorealistic Radiance Fields (…

Semantic correspondence

Attribute-controlled face photo synthesis from simple line drawing

2017-02-09 · Qi Guo, Ce Zhu, Zhiqiang Xia, Zhengtao Wang 외

Face photo synthesis from simple line drawing is a one-to-many task as simple line drawing merely contains the contour of human face. Previous exemplar-based methods are over-dependent on the datasets and are hard to gen…

Attribute

MagiCapture: High-Resolution Multi-Concept Portrait Customization

2023-09-13 · Junha Hyung, Jaeyo Shin, Jaegul Choo

Large-scale text-to-image models including Stable Diffusion are capable of generating high-fidelity photorealistic portrait images. There is an active research area dedicated to personalizing these models, aiming to synt…

Image GenerationWeakly-supervised Learning