paper-with-me

홈 › Papers

HarmonyIQA: Pioneering Benchmark and Model for Image Harmonization Quality Assessment

2025-01-02 · Zitong Xu, Huiyu Duan, Guangji Ma, Liu Yang, Jiarui Wang, Qingbo Wu, Xiongkuo Min, Guangtao Zhai, Patrick Le Callet

Image composition involves extracting a foreground object from one image and pasting it into another image through Image harmonization algorithms (IHAs), which aim to adjust the appearance of the foreground object to better match the background. Existing image quality assessment (IQA) methods may fail to align with human visual preference on image harmonization due to the insensitivity to minor color or light inconsistency. To address the issue and facilitate the advancement of IHAs, we introduce the first Image Quality Assessment Database for image Harmony evaluation (HarmonyIQAD), which consists of 1,350 harmonized images generated by 9 different IHAs, and the corresponding human visual preference scores. Based on this database, we propose a Harmony Image Quality Assessment (HarmonyIQA), to predict human visual preference for harmonized images. Extensive experiments show that HarmonyIQA achieves state-of-the-art performance on human visual preference evaluation for harmonized images, and also achieves competing results on traditional IQA tasks. Furthermore, cross-dataset evaluation also shows that HarmonyIQA exhibits better generalization ability than self-supervised learning-based IQA methods. Both HarmonyIQAD and HarmonyIQA will be made publicly available upon paper publication.

📄 PDF Abstract BibTeX arXiv:2501.01116

Code (0)

등록된 구현이 없습니다.

Tasks

Image HarmonizationImage Quality AssessmentSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Quantitative Metrics for Benchmarking Medical Image Harmonization

2024-02-06 · Abhijeet Parida, Zhifan Jiang, Roger J. Packer, Robert A. Avery 외

Image harmonization is an important preprocessing strategy to address domain shifts arising from data acquired using different machines and scanning protocols in medical imaging. However, benchmarking the effectiveness o…

AnatomyBenchmarkingImage HarmonizationImage Quality Assessment

SSH: A Self-Supervised Framework for Image Harmonization

2021-08-15 · ICCV 2021 10 · Yifan Jiang, He Zhang, Jianming Zhang, Yilin Wang 외

Image harmonization aims to improve the quality of image compositing by matching the "appearance" (\eg, color tone, brightness and contrast) between foreground and background images. However, collecting large-scale annot…

BenchmarkingData AugmentationImage Harmonization

BargainNet: Background-Guided Domain Translation for Image Harmonization

2020-09-19 · Wenyan Cong, Li Niu, Jianfu Zhang, Jing Liang 외

Image composition is a fundamental operation in image editing field. However, unharmonious foreground and background downgrade the quality of composite image. Image harmonization, which adjusts the foreground to improve …

Image HarmonizationTranslationTriplet

Image Harmonization Dataset iHarmony4: HCOCO, HAdobe5k, HFlickr, and Hday2night

2019-08-28 · Wenyan Cong, Jianfu Zhang, Li Niu, Liu Liu 외

Image composition is an important operation in image processing, but the inconsistency between foreground and background significantly degrades the quality of composite image. Image harmonization, which aims to make the …

DiversityImage Harmonization

DoveNet: Deep Image Harmonization via Domain Verification

2019-11-27 · CVPR 2020 6 · Wenyan Cong, Jianfu Zhang, Li Niu, Liu Liu 외

Image composition is an important operation in image processing, but the inconsistency between foreground and background significantly degrades the quality of composite image. Image harmonization, aiming to make the fore…

Image Harmonization