Papers Video Emotion Recognition
“Video Emotion Recognition” 태그가 달린 논문 31편 · 필터 해제
CLIP-AUTT: Test-Time Personalization with Action Unit Prompting for Fine-Grained Video Emotion Recognition
Personalization in emotion recognition (ER) is essential for accurate interpretation of subtle and subject-specific expressive patterns. Recent advances in vision-language models (VLMs), such as CLIP, demonstrate strong …
Facial Expression RecognitionVideo Emotion RecognitionMultimodal Video Emotion Recognition with Reliable Reasoning Priors
This study investigates the integration of trustworthy prior reasoning knowledge from MLLMs into multimodal emotion recognition. We employ Gemini to generate fine-grained, modality-separable reasoning traces, which are i…
Multimodal Emotion RecognitionVideo Emotion RecognitionContrastive LearningVAEmo: Efficient Representation Learning for Visual-Audio Emotion with Knowledge Injection
Audiovisual emotion recognition (AVER) aims to infer human emotions from nonverbal visual-audio (VA) cues, offering modality-complementary and language-agnostic advantages. However, AVER remains challenging due to the in…
Contrastive LearningDynamic Facial Expression RecognitionEmotion RecognitionRepresentation Learning+2Visual and textual prompts for enhancing emotion recognition in video
Vision Large Language Models (VLLMs) exhibit promising potential for multi-modal understanding, yet their application to video-based emotion recognition remains limited by insufficient spatial and contextual awareness. T…
Emotion RecognitionVideo Emotion RecognitionVisual PromptingMTCAE-DFER: Multi-Task Cascaded Autoencoder for Dynamic Facial Expression Recognition
This paper expands the cascaded network branch of the autoencoder-based multi-task learning (MTL) framework for dynamic facial expression recognition, namely Multi-Task Cascaded Autoencoder for Dynamic Facial Expression …
Dynamic Facial Expression RecognitionFace DetectionFacial Emotion RecognitionFacial Expression Recognition+2VEMOCLAP: A video emotion classification web application
We introduce VEMOCLAP: Video EMOtion Classifier using Pretrained features, the first readily available and open-source web application that analyzes the emotional content of any user-provided video. We improve our previo…
ClassificationEmotion ClassificationVideo Emotion RecognitionFE-Adapter: Adapting Image-based Emotion Classifiers to Videos
Utilizing large pre-trained models for specific tasks has yielded impressive results. However, fully fine-tuning these increasingly large models is becoming prohibitively resource-intensive. This has led to a focus on mo…
Dynamic Facial Expression RecognitionEmotion RecognitionTransfer LearningVideo Emotion Recognition+1MultiMAE-DER: Multimodal Masked Autoencoder for Dynamic Emotion Recognition
This paper presents a novel approach to processing multimodal data for dynamic emotion recognition, named as the Multimodal Masked Autoencoder for Dynamic Emotion Recognition (MultiMAE-DER). The MultiMAE-DER leverages th…
Emotion RecognitionMultimodal Emotion RecognitionSelf-Supervised LearningVideo Emotion RecognitionMART: Masked Affective RepresenTation Learning via Masked Temporal Distribution Distillation
Limited training data is a long-standing problem for video emotion analysis (VEA). Existing works leverage the power of large-scale image datasets for transferring while failing to extract the temporal correlation of…
Emotion RecognitionMultimodal Emotion RecognitionMultimodal Sentiment AnalysisRepresentation Learning+2Towards Emotion Analysis in Short-form Videos: A Large-Scale Dataset and Baseline
Nowadays, short-form videos (SVs) are essential to web information acquisition and sharing in our daily life. The prevailing use of SVs to spread emotions leads to the necessity of conducting video emotion analysis (VEA)…
audio-visual learningFormMultimodal Emotion RecognitionVideo Emotion RecognitionAffective Video Content Analysis: Decade Review and New Perspectives
Video content is rich in semantics and has the ability to evoke various emotions in viewers. In recent years, with the rapid development of affective computing and the explosive growth of visual data, affective video con…
Emotional IntelligenceEmotion RecognitionFacial Expression RecognitionVideo Emotion RecognitionFuzzy Approach for Audio-Video Emotion Recognition in Computer Games for Children
Computer games are widespread nowadays and enjoyed by people of all ages. But when it comes to kids, playing these games can be more than just fun, it is a way for them to develop important skills and build emotional int…
Audio Emotion RecognitionEmotional IntelligenceEmotion RecognitionVideo Emotion RecognitionVersatile audio-visual learning for emotion recognition
Most current audio-visual emotion recognition models lack the flexibility needed for deployment in practical applications. We envision a multimodal system that works even when only one modality is available and can be im…
Arousal EstimationAttributeaudio-visual learningEmotion Classification+6Weakly Supervised Video Emotion Detection and Prediction via Cross-Modal Temporal Erasing Network
Automatically predicting the emotions of user-generated videos (UGVs) receives increasing interest recently. However, existing methods mainly focus on a few key visual frames, which may limit their capacity to encode…
Video Emotion DetectionVideo Emotion RecognitionRepresentation Learning through Multimodal Attention and Time-Sync Comments for Affective Video Content Analysis
Although temporal patterns inherent in visual and audio signals are crucial for affective video content analysis, they have not been thoroughly explored yet. In this paper, we propose a novel Temporal-Aware Multimodal (T…
Representation LearningVideo Emotion RecognitionFV2ES: A Fully End2End Multimodal System for Fast Yet Effective Video Emotion Recognition Inference
In the latest social networks, more and more people prefer to express their emotions in videos through text, speech, and rich facial expressions. Multimodal video emotion analysis techniques can help understand users' in…
Emotion RecognitionMultimodal Emotion RecognitionVideo Emotion RecognitionICANet: A Method of Short Video Emotion Recognition Driven by Multimodal Data
With the fast development of artificial intelligence and short videos, emotion recognition in short videos has become one of the most important research topics in human-computer interaction. At present, most emotion reco…
Emotion RecognitionOptical Flow EstimationVideo Emotion RecognitionMulti-modal Residual Perceptron Network for Audio-Video Emotion Recognition
Audio-Video Emotion Recognition is now attacked with Deep Neural Network modeling tools. In published papers, as a rule, the authors show only cases of the superiority in multi-modality over audio-only or video-only moda…
Emotion RecognitionVideo Emotion RecognitionTechnical Report for Valence-Arousal Estimation on Affwild2 Dataset
In this work, we describe our method for tackling the valence-arousal estimation challenge from ABAW FG-2020 Competition. The competition organizers provide an in-the-wild Aff-Wild2 dataset for participants to analyze af…
Arousal EstimationEmotion RecognitionVideo Emotion RecognitionExploring Emotion Features and Fusion Strategies for Audio-Video Emotion Recognition
The audio-video based emotion recognition aims to classify a given video into basic emotions. In this paper, we describe our approaches in EmotiW 2019, which mainly explores emotion features and feature fusion strategies…
Emotion RecognitionFacial Expression Recognition (FER)Video Emotion Recognition