paper-with-me

Papers

Interactive Portrait Harmonization

2022-03-15 · Jeya Maria Jose Valanarasu, He Zhang, Jianming Zhang, Yilin Wang, Zhe Lin, Jose Echevarria, Yinglan Ma, Zijun Wei, Kalyan Sunkavalli, Vishal M. Patel

Current image harmonization methods consider the entire background as the guidance for harmonization. However, this may limit the capability for user to choose any specific object/person in the background to guide the harmonization. To enable flexible interaction between user and harmonization, we introduce interactive harmonization, a new setting where the harmonization is performed with respect to a selected \emph{region} in the reference image instead of the entire background. A new flexible framework that allows users to pick certain regions of the background image and use it to guide the harmonization is proposed. Inspired by professional portrait harmonization users, we also introduce a new luminance matching loss to optimally match the color/luminance conditions between the composite foreground and select reference region. This framework provides more control to the image harmonization pipeline achieving visually pleasing portrait edits. Furthermore, we also introduce a new dataset carefully curated for validating portrait harmonization. Extensive experiments on both synthetic and real-world datasets show that the proposed approach is efficient and robust compared to previous harmonization baselines, especially for portraits. Project Webpage at \href{https://jeya-maria-jose.github.io/IPH-web/}{https://jeya-maria-jose.github.io/IPH-web/}

📄 PDF Abstract BibTeX arXiv:2203.08216

Code (0)

등록된 구현이 없습니다.

Tasks

Image Harmonization

Similar Papers 제목 키워드 기반

MegaPortrait: Revisiting Diffusion Control for High-fidelity Portrait Generation

2024-11-07 · Han Yang, Sotiris Anagnostidis, Enis Simsar, Thomas Hofmann

We propose MegaPortrait. It's an innovative system for creating personalized portrait images in computer vision. It has three modules: Identity Net, Shading Net, and Harmonization Net. Identity Net generates learned iden…

PHNet: Patch-based Normalization for Portrait Harmonization

2024-02-27 · Karen Efremyan, Elizaveta Petrova, Evgeny Kaskov, Alexander Kapitanov

A common problem for composite images is the incompatibility of their foreground and background components. Image harmonization aims to solve this problem, making the whole image look more authentic and coherent. Most ex…

Image Harmonization

Relightful Harmonization: Lighting-aware Portrait Background Replacement

2023-12-11 · CVPR 2024 1 · Mengwei Ren, Wei Xiong, Jae Shin Yoon, Zhixin Shu 외

Portrait harmonization aims to composite a subject into a new background, adjusting its lighting and color to ensure harmony with the background scene. Existing harmonization techniques often only focus on adjusting the …

Interactive Data Harmonization with LLM Agents

2025-02-10 · Aécio Santos, Eduardo H. M. Pena, Roque Lopez, Juliana Freire

Data harmonization is an essential task that entails integrating datasets from diverse sources. Despite years of research in this area, it remains a time-consuming and challenging task due to schema mismatches, varying t…

HarmoVid: Relightful Video Portrait Harmonization

2026-05-27 · Jun Myeong Choi, Jae Shin Yoon, Luchao Qi, Roni Sengupta 외 arxiv

We present a method for harmonizing the lighting of a foreground video to match a target background scene, adjusting shadows, color tone, and illumination intensity (relightful harmonization). Unlike images, acquiring la…