paper-with-me

홈 › Papers

Make Me Happier: Evoking Emotions Through Image Diffusion Models

2024-03-13 · Qing Lin, Jingfeng Zhang, Yew Soon Ong, Mengmi Zhang

Despite the rapid progress in image generation, emotional image editing remains under-explored. The semantics, context, and structure of an image can evoke emotional responses, making emotional image editing techniques valuable for various real-world applications, including treatment of psychological disorders, commercialization of products, and artistic design. For the first time, we present a novel challenge of emotion-evoked image generation, aiming to synthesize images that evoke target emotions while retaining the semantics and structures of the original scenes. To address this challenge, we propose a diffusion model capable of effectively understanding and editing source images to convey desired emotions and sentiments. Moreover, due to the lack of emotion editing datasets, we provide a unique dataset consisting of 340,000 pairs of images and their emotion annotations. Furthermore, we conduct human psychophysics experiments and introduce four new evaluation metrics to systematically benchmark all the methods. Experimental results demonstrate that our method surpasses all competitive baselines. Our diffusion model is capable of identifying emotional cues from original images, editing images that elicit desired emotions, and meanwhile, preserving the semantic structure of the original images. All code, model, and dataset will be made public.

📄 PDF Abstract BibTeX arXiv:2403.08255

Code (0)

등록된 구현이 없습니다.

Tasks

Image Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

EmoEdit: Evoking Emotions through Image Manipulation

2024-05-21 · CVPR 2025 1 · Jingyuan Yang, Jiawei Feng, Weibin Luo, Dani Lischinski 외

Affective Image Manipulation (AIM) seeks to modify user-provided images to evoke specific emotional responses. This task is inherently complex due to its twofold objective: significantly evoking the intended emotion, whi…

Image ManipulationLanguage Modelling

Commonly Interesting Images

2024-09-25 · Fitim Abdullahu, Helmut Grabner

Images tell stories, trigger emotions, and let us recall memories -- they make us think. Thus, they have the ability to attract and hold one's attention, which is the definition of being "interesting". Yet, the appeal of…

Level of agreement between emotions generated by Artificial Intelligence and human evaluation: a methodological proposal

2024-10-10 · Miguel Carrasco, Cesar Gonzalez-Martin, Sonia Navajas-Torrente, Raul Dastres

Images are capable of conveying emotions, but emotional experience is highly subjective. Advances in artificial intelligence have enabled the generation of images based on emotional descriptions. However, the level of ag…

An Interpretable Neural Network with Topical Information for Relevant Emotion Ranking

2018-10-01 · EMNLP 2018 10 · Yang Yang, Deyu Zhou, Yulan He

Text might express or evoke multiple emotions with varying intensities. As such, it is crucial to predict and rank multiple relevant emotions by their intensities. Moreover, as emotions might be evoked by hidden topics, …

Common Sense ReasoningEmotion ClassificationMulti-Label LearningTopic Models+1

Image color transfer to evoke different emotions based on color combinations

2013-07-12 · Li He, Hairong Qi, Russell Zaretzki

In this paper, a color transfer framework to evoke different emotions for images based on color combinations is proposed. The purpose of this color transfer is to change the "look and feel" of images, i.e., evoking diffe…