PCT-Net: Full Resolution Image Harmonization Using Pixel-Wise Color Transformations
In this paper, we present PCT-Net, a simple and general image harmonization method that can be easily applied to images at full resolution. The key idea is to learn a parameter network that uses downsampled input images to predict the parameters for pixel-wise color transforms (PCTs) which are applied to each pixel in the full-resolution image. We show that affine color transforms are both efficient and effective, resulting in state-of-the-art harmonization results. Moreover, we explore both CNNs and Transformers as the parameter network and show that Transformers lead to better results. We evaluate the proposed method on the public full-resolution iHarmony4 dataset, which is comprised of four datasets, and show a reduction of the foreground MSE (fMSE) and MSE values by more than 20% and an increase of the PSNR value by 1.4dB while keeping the architecture light-weight. In a user study with 20 people, we show that the method achieves a higher B-T score than two other recent methods.
Code (1)
Tasks
Image HarmonizationSimilar Papers 제목 키워드 기반
High-Resolution Image Harmonization via Collaborative Dual Transformations
Given a composite image, image harmonization aims to adjust the foreground to make it compatible with the background. High-resolution image harmonization is in high demand, but still remains unexplored. Conventional imag…
Image HarmonizationVocal Bursts Intensity PredictionDense Pixel-to-Pixel Harmonization via Continuous Image Representation
High-resolution (HR) image harmonization is of great significance in real-world applications such as image synthesis and image editing. However, due to the high memory costs, existing dense pixel-to-pixel harmonization m…
Image GenerationImage HarmonizationHarmonizer: Learning to Perform White-Box Image and Video Harmonization
Recent works on image harmonization solve the problem as a pixel-wise image translation task via large autoencoders. They have unsatisfactory performances and slow inference speeds when dealing with high-resolution image…
Image HarmonizationVideo HarmonizationSpatial-Separated Curve Rendering Network for Efficient and High-Resolution Image Harmonization
Image harmonization aims to modify the color of the composited region with respect to the specific background. Previous works model this task as a pixel-wise image-to-image translation using UNet family structures. Howev…
GPUImage HarmonizationImage-to-Image TranslationPlaying the Game of 2048+1Temporally Coherent Video Harmonization Using Adversarial Networks
Compositing is one of the most important editing operations for images and videos. The process of improving the realism of composite results is often called harmonization. Previous approaches for harmonization mainly foc…
Video Harmonization