paper-with-me

홈 › Papers

Compound Expression Recognition via Multi Model Ensemble for the ABAW7 Challenge

2024-07-17 · Xuxiong Liu, Kang Shen, Jun Yao, Boyan Wang, Minrui Liu, Liuwei An, Zishun Cui, Weijie Feng, Xiao Sun

Compound Expression Recognition (CER) is vital for effective interpersonal interactions. Human emotional expressions are inherently complex due to the presence of compound expressions, requiring the consideration of both local and global facial cues for accurate judgment. In this paper, we propose an ensemble learning-based solution to address this complexity. Our approach involves training three distinct expression classification models using convolutional networks, Vision Transformers, and multiscale local attention networks. By employing late fusion for model ensemble, we combine the outputs of these models to predict the final results. Our method demonstrates high accuracy on the RAF-DB datasets and is capable of recognizing expressions in certain portions of the C-EXPR-DB through zero-shot learning.

📄 PDF Abstract BibTeX arXiv:2407.12257

Code (0)

등록된 구현이 없습니다.

Tasks

Ensemble LearningZero-Shot Learning

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Zero-shot Compound Expression Recognition with Visual Language Model at the 6th ABAW Challenge

2024-03-18 · Jiahe Wang, Jiale Huang, Bingzhao Cai, Yifan Cao 외

Conventional approaches to facial expression recognition primarily focus on the classification of six basic facial expressions. Nevertheless, real-world situations present a wider range of complex compound expressions th…

Facial Expression RecognitionLanguage ModelingLanguage Modelling

7th ABAW Competition: Multi-Task Learning and Compound Expression Recognition

2024-07-04 · Dimitrios Kollias, Stefanos Zafeiriou, Irene Kotsia, Abhinav Dhall 외

This paper describes the 7th Affective Behavior Analysis in-the-wild (ABAW) Competition, which is part of the respective Workshop held in conjunction with ECCV 2024. The 7th ABAW Competition addresses novel challenges in…

Multi-Task Learning

Feature-Based Dual Visual Feature Extraction Model for Compound Multimodal Emotion Recognition

2025-03-21 · Ran Liu, Fengyu Zhang, Cong Yu, Longjiang Yang 외

This article presents our results for the eighth Affective Behavior Analysis in-the-wild (ABAW) competition.Multimodal emotion recognition (ER) has important applications in affective computing and human-computer interac…

Emotion RecognitionMultimodal Emotion Recognition

Audio-Visual Compound Expression Recognition Method based on Late Modality Fusion and Rule-based Decision

2024-03-19 · Elena Ryumina, Maxim Markitantov, Dmitry Ryumin, Heysem Kaya 외

This paper presents the results of the SUN team for the Compound Expressions Recognition Challenge of the 6th ABAW Competition. We propose a novel audio-visual method for compound expression recognition. Our method relie…

Cross-corpusEmotion Recognitionzero-shot-classificationZero-Shot Learning

HSEmotion Team at the 6th ABAW Competition: Facial Expressions, Valence-Arousal and Emotion Intensity Prediction

2024-03-18 · Andrey V. Savchenko

This article presents our results for the sixth Affective Behavior Analysis in-the-wild (ABAW) competition. To improve the trustworthiness of facial analysis, we study the possibility of using pre-trained deep models tha…