Investigating Emotion-Color Association in Deep Neural Networks
Recent research has shown that Deep Neural Networks (DNNs) correlate very well to neural responses, and are widely used by cognitive scientists as a proxy for human representation to model human behavior. But previously it has not been explored whether DNNs capture any aspects of stimuli association. In this study, we experimentally investigate if DNNs can learn implicit associations in stimuli, particularly, an emotion-color association between image stimuli. Our study was conducted in two parts. First, we collected human responses on a forced-choice decision task in which subjects were asked to select a color for a specified emotion-inducing image. Next, we modeled this decision task on neural networks using the similarity between deep representation (extracted using DNNs trained on object classification tasks) of the stimuli images and images of colors used in the task. We found that our model showed a fuzzy linear relationship between the two decision probabilities. This results in two interesting findings, 1. The representations learned by deep neural networks can indeed show an emotion-color association 2. The emotion-color association is not just random but involves some cognitive phenomena. Finally, we also show that this method can help us in the emotion classification task.
Code (0)
등록된 구현이 없습니다.
Tasks
Emotion ClassificationSimilar Papers 제목 키워드 기반
Investigating Emotion-Color Association in Deep Neural Networks
It has been found that representations learned by Deep Neural Networks (DNNs) correlate very well to neural responses measured in primates' brains and psychological representations exhibited by human similarity judgment.…
Emotional IntelligenceEmotion ClassificationColor-Emotion Associations in Art: Fuzzy Approach
Art objects can evoke certain emotions. Color is a fundamental element of visual art and plays a significant role in how art is perceived. This paper introduces a novel approach to classifying emotions in art using Fuzzy…
MarketingExtrapolating continuous color emotions through deep learning
By means of an experimental dataset, we use deep learning to implement an RGB extrapolation of emotions associated to color, and do a mathematical study of the results obtained through this neural network. In particular,…
Deep LearningDecoding Emotions in Abstract Art: Cognitive Plausibility of CLIP in Recognizing Color-Emotion Associations
This study investigates the cognitive plausibility of a pretrained multimodal model, CLIP, in recognizing emotions evoked by abstract visual art. We employ a dataset comprising images with associated emotion labels and t…
Emotion Classification