paper-with-me

Papers

Disharmony: Forensics using Reverse Lighting Harmonization

2025-01-17 · Philip Wootaek Shin, Jack Sampson, Vijaykrishnan Narayanan, Andres Marquez, Mahantesh Halappanavar

Content generation and manipulation approaches based on deep learning methods have seen significant advancements, leading to an increased need for techniques to detect whether an image has been generated or edited. Another area of research focuses on the insertion and harmonization of objects within images. In this study, we explore the potential of using harmonization data in conjunction with a segmentation model to enhance the detection of edited image regions. These edits can be either manually crafted or generated using deep learning methods. Our findings demonstrate that this approach can effectively identify such edits. Existing forensic models often overlook the detection of harmonized objects in relation to the background, but our proposed Disharmony Network addresses this gap. By utilizing an aggregated dataset of harmonization techniques, our model outperforms existing forensic networks in identifying harmonized objects integrated into their backgrounds, and shows potential for detecting various forms of edits, including virtual try-on tasks.

📄 PDF Abstract BibTeX arXiv:2501.10212

Code (0)

등록된 구현이 없습니다.

Tasks

Virtual Try-on

Similar Papers 제목 키워드 기반

Temporally Coherent Video Harmonization Using Adversarial Networks

2018-09-05 · Hao-Zhi Huang, Senzhe Xu, Junxiong Cai, Wei Liu 외

Compositing is one of the most important editing operations for images and videos. The process of improving the realism of composite results is often called harmonization. Previous approaches for harmonization mainly foc…

Video Harmonization

Intrinsic Harmonization for Illumination-Aware Compositing

2023-12-06 · Chris Careaga, S. Mahdi H. Miangoleh, Yağız Aksoy

Despite significant advancements in network-based image harmonization techniques, there still exists a domain disparity between typical training pairs and real-world composites encountered during inference. Most existing…

Image HarmonizationImage Relighting

Embracing the Disharmony in Medical Imaging: A Simple and Effective Framework for Domain Adaptation

2021-03-23 · Rongguang Wang, Pratik Chaudhari, Christos Davatzikos

Domain shift, the mismatch between training and testing data characteristics, causes significant degradation in the predictive performance in multi-source imaging scenarios. In medical imaging, the heterogeneity of popul…

Auxiliary LearningDomain AdaptationDomain GeneralizationMulti-Task Learning

HarmoVid: Relightful Video Portrait Harmonization

2026-05-27 · Jun Myeong Choi, Jae Shin Yoon, Luchao Qi, Roni Sengupta 외 arxiv

We present a method for harmonizing the lighting of a foreground video to match a target background scene, adjusting shadows, color tone, and illumination intensity (relightful harmonization). Unlike images, acquiring la…

Relightful Harmonization: Lighting-aware Portrait Background Replacement

2023-12-11 · CVPR 2024 1 · Mengwei Ren, Wei Xiong, Jae Shin Yoon, Zhixin Shu 외

Portrait harmonization aims to composite a subject into a new background, adjusting its lighting and color to ensure harmony with the background scene. Existing harmonization techniques often only focus on adjusting the …