MIDAS: Mixing Ambiguous Data with Soft Labels for Dynamic Facial Expression Recognition
Dynamic facial expression recognition (DFER) is an important task in the field of computer vision. To apply automatic DFER in practice, it is necessary to accurately recognize ambiguous facial expressions, which often appear in data in the wild. In this paper, we propose MIDAS, a data augmentation method for DFER, which augments ambiguous facial expression data with soft labels consisting of probabilities for multiple emotion classes. In MIDAS, the training data are augmented by convexly combining pairs of video frames and their corresponding emotion class labels, which can also be regarded as an extension of mixup to soft-labeled video data. This simple extension is remarkably effective in DFER with ambiguous facial expression data. To evaluate MIDAS, we conducted experiments on the DFEW dataset. The results demonstrate that the model trained on the data augmented by MIDAS outperforms the existing state-of-the-art method trained on the original dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationDynamic Facial Expression RecognitionFacial Expression RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Enhancing Ambiguous Dynamic Facial Expression Recognition with Soft Label-based Data Augmentation
Dynamic facial expression recognition (DFER) is a task that estimates emotions from facial expression video sequences. For practical applications, accurately recognizing ambiguous facial expressions -- frequently encount…
Data AugmentationDynamic Facial Expression RecognitionFacial Expression RecognitionLearning from Ambiguous Data with Hard Labels
Real-world data often contains intrinsic ambiguity that the common single-hard-label annotation paradigm ignores. Standard training using ambiguous data with these hard labels may produce overly confident models and thus…
CPUSelectMix: Enhancing Label Noise Robustness through Targeted Sample Mixing
Deep neural networks tend to memorize noisy labels, severely degrading their generalization performance. Although Mixup has demonstrated effectiveness in improving generalization and robustness, existing Mixup-based meth…
Learning with noisy labelsMulti-Granularity Detector for Vulnerability Fixes
With the increasing reliance on Open Source Software, users are exposed to third-party library vulnerabilities. Software Composition Analysis (SCA) tools have been created to alert users of such vulnerabilities. SCA requ…
MIDAS: Misalignment-based Data Augmentation Strategy for Imbalanced Multimodal Learning
Multimodal models often over-rely on dominant modalities, failing to achieve optimal performance. While prior work focuses on modifying training objectives or optimization procedures, data-centric solutions remain undere…
Data Augmentation