paper-with-me

홈 › Papers

Unlocking the Emotional World of Visual Media: An Overview of the Science, Research, and Impact of Understanding Emotion

2023-07-25 · James Z. Wang, Sicheng Zhao, Chenyan Wu, Reginald B. Adams, Michelle G. Newman, Tal Shafir, Rachelle Tsachor

The emergence of artificial emotional intelligence technology is revolutionizing the fields of computers and robotics, allowing for a new level of communication and understanding of human behavior that was once thought impossible. While recent advancements in deep learning have transformed the field of computer vision, automated understanding of evoked or expressed emotions in visual media remains in its infancy. This foundering stems from the absence of a universally accepted definition of "emotion", coupled with the inherently subjective nature of emotions and their intricate nuances. In this article, we provide a comprehensive, multidisciplinary overview of the field of emotion analysis in visual media, drawing on insights from psychology, engineering, and the arts. We begin by exploring the psychological foundations of emotion and the computational principles that underpin the understanding of emotions from images and videos. We then review the latest research and systems within the field, accentuating the most promising approaches. We also discuss the current technological challenges and limitations of emotion analysis, underscoring the necessity for continued investigation and innovation. We contend that this represents a "Holy Grail" research problem in computing and delineate pivotal directions for future inquiry. Finally, we examine the ethical ramifications of emotion-understanding technologies and contemplate their potential societal impacts. Overall, this article endeavors to equip readers with a deeper understanding of the domain of emotion analysis in visual media and to inspire further research and development in this captivating and rapidly evolving field.

📄 PDF Abstract BibTeX arXiv:2307.13463

Code (0)

등록된 구현이 없습니다.

Tasks

Emotional IntelligenceEmotion Recognition

Similar Papers 제목 키워드 기반

Visual Sentiment Analysis: A Natural DisasterUse-case Task at MediaEval 2021

2021-11-22 · Syed Zohaib Hassan, Kashif Ahmad, Michael A. Riegler, Steven Hicks 외

The Visual Sentiment Analysis task is being offered for the first time at MediaEval. The main purpose of the task is to predict the emotional response to images of natural disasters shared on social media. Disaster-relat…

Sentiment Analysis

Revealing Patient-Reported Experiences in Healthcare from Social Media using the DAPMAV Framework

2022-10-09 · Curtis Murray, Lewis Mitchell, Jonathan Tuke, Mark Mackay

Understanding patient experience in healthcare is increasingly important and desired by medical professionals in a patient-centered care approach. Healthcare discourse on social media presents an opportunity to gain a un…

Rank-O-ToM: Unlocking Emotional Nuance Ranking to Enhance Affective Theory-of-Mind

2025-02-24 · Jihyun Kim, JuneHyoung Kwon, Mihyeon Kim, Eunju Lee 외

Facial Expression Recognition (FER) plays a foundational role in enabling AI systems to interpret emotional nuances, a critical aspect of affective Theory of Mind (ToM). However, existing models often struggle with poor …

Facial Expression RecognitionFacial Expression Recognition (FER)

Large language models for newspaper sentiment analysis during COVID-19: The Guardian

2024-05-20 · Rohitash Chandra, Baicheng Zhu, Qingying Fang, Eka Shinjikashvili

During the COVID-19 pandemic, the news media coverage encompassed a wide range of topics that includes viral transmission, allocation of medical resources, and government response measures. There have been studies on sen…

Sentiment Analysis

Using Affective Features from Media Content Metadata for Better Movie Recommendations

2020-07-01 · John Kalung Leung, Igor Griva, William G. Kennedy

This paper investigates the causality in the decision making of movie recommendations through the users' affective profiles. We advocate a method of assigning emotional tags to a movie by the auto-detection of the affect…

Decision Making