Cross-Task Inconsistency Based Active Learning (CTIAL) for Emotion Recognition
Emotion recognition is a critical component of affective computing. Training accurate machine learning models for emotion recognition typically requires a large amount of labeled data. Due to the subtleness and complexity of emotions, multiple evaluators are usually needed for each affective sample to obtain its ground-truth label, which is expensive. To save the labeling cost, this paper proposes an inconsistency-based active learning approach for cross-task transfer between emotion classification and estimation. Affective norms are utilized as prior knowledge to connect the label spaces of categorical and dimensional emotions. Then, the prediction inconsistency on the two tasks for the unlabeled samples is used to guide sample selection in active learning for the target task. Experiments on within-corpus and cross-corpus transfers demonstrated that cross-task inconsistency could be a very valuable metric in active learning. To our knowledge, this is the first work that utilizes prior knowledge on affective norms and data in a different task to facilitate active learning for a new task, even the two tasks are from different datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningCross-corpusEmotion ClassificationEmotion RecognitionSimilar Papers 제목 키워드 기반
Connecting the Equinoctial Elements and Rodrigues Parameters: A New Set of Elements
A geometric interpretation of the equinoctial elements is given with a connection to orthogonal rotations and attitude dynamics in Euclidean 3-space. An identification is made between the equinoctial elements and classic…
Joint Alignment of Multi-Task Feature and Label Spaces for Emotion Cause Pair Extraction
Emotion cause pair extraction (ECPE), as one of the derived subtasks of emotion cause analysis (ECA), shares rich inter-related features with emotion extraction (EE) and cause extraction (CE). Therefore EE and CE are fre…
Emotion-Cause Pair ExtractionMulti-Task LearningEvaluation of data inconsistency for multi-modal sentiment analysis
Emotion semantic inconsistency is an ubiquitous challenge in multi-modal sentiment analysis (MSA). MSA involves analyzing sentiment expressed across various modalities like text, audio, and videos. Each modality may conv…
Emotion RecognitionSentiment AnalysisCommuting Distance Regularization for Timescale-Dependent Label Inconsistency in EEG Emotion Recognition
In this work, we address the often-overlooked issue of Timescale Dependent Label Inconsistency (TsDLI) in training neural network models for EEG-based human emotion recognition. To mitigate TsDLI and enhance model genera…
EEG Emotion RecognitionInconsistency-Aware Cross-Attention for Audio-Visual Fusion in Dimensional Emotion Recognition
Leveraging complementary relationships across modalities has recently drawn a lot of attention in multimodal emotion recognition. Most of the existing approaches explored cross-attention to capture the complementary rela…
Emotion RecognitionMultimodal Emotion Recognition