paper-with-me

Papers

PCT-Net: Full Resolution Image Harmonization Using Pixel-Wise Color Transformations

2023-01-01 · CVPR 2023 1 · Julian Jorge Andrade Guerreiro, Mitsuru Nakazawa, Björn Stenger

In this paper, we present PCT-Net, a simple and general image harmonization method that can be easily applied to images at full resolution. The key idea is to learn a parameter network that uses downsampled input images to predict the parameters for pixel-wise color transforms (PCTs) which are applied to each pixel in the full-resolution image. We show that affine color transforms are both efficient and effective, resulting in state-of-the-art harmonization results. Moreover, we explore both CNNs and Transformers as the parameter network and show that Transformers lead to better results. We evaluate the proposed method on the public full-resolution iHarmony4 dataset, which is comprised of four datasets, and show a reduction of the foreground MSE (fMSE) and MSE values by more than 20% and an increase of the PSNR value by 1.4dB while keeping the architecture light-weight. In a user study with 20 people, we show that the method achieves a higher B-T score than two other recent methods.

📄 PDF Abstract BibTeX

Code (1)

rakutentech/PCT-Net-Image-Harmonization 공식 구현 pytorch

Tasks

Image Harmonization

Similar Papers 제목 키워드 기반

High-Resolution Image Harmonization via Collaborative Dual Transformations

2021-09-14 · CVPR 2022 1 · Wenyan Cong, Xinhao Tao, Li Niu, Jing Liang 외

Given a composite image, image harmonization aims to adjust the foreground to make it compatible with the background. High-resolution image harmonization is in high demand, but still remains unexplored. Conventional imag…

Image HarmonizationVocal Bursts Intensity Prediction

Dense Pixel-to-Pixel Harmonization via Continuous Image Representation

2023-03-03 · Jianqi Chen, Yilan Zhang, Zhengxia Zou, Keyan Chen 외

High-resolution (HR) image harmonization is of great significance in real-world applications such as image synthesis and image editing. However, due to the high memory costs, existing dense pixel-to-pixel harmonization m…

Image GenerationImage Harmonization

Harmonizer: Learning to Perform White-Box Image and Video Harmonization

2022-07-04 · Zhanghan Ke, Chunyi Sun, Lei Zhu, Ke Xu 외

Recent works on image harmonization solve the problem as a pixel-wise image translation task via large autoencoders. They have unsatisfactory performances and slow inference speeds when dealing with high-resolution image…

Image HarmonizationVideo Harmonization

Spatial-Separated Curve Rendering Network for Efficient and High-Resolution Image Harmonization

2021-09-13 · Jingtang Liang, Xiaodong Cun, Chi-Man Pun, Jue Wang

Image harmonization aims to modify the color of the composited region with respect to the specific background. Previous works model this task as a pixel-wise image-to-image translation using UNet family structures. Howev…

GPUImage HarmonizationImage-to-Image TranslationPlaying the Game of 2048+1

Temporally Coherent Video Harmonization Using Adversarial Networks

2018-09-05 · Hao-Zhi Huang, Senzhe Xu, Junxiong Cai, Wei Liu 외

Compositing is one of the most important editing operations for images and videos. The process of improving the realism of composite results is often called harmonization. Previous approaches for harmonization mainly foc…

Video Harmonization