Exploring Self-Supervised Multi-view Contrastive Learning for Speech Emotion Recognition with Limited Annotations
Recent advancements in Deep and Self-Supervised Learning (SSL) have led to substantial improvements in Speech Emotion Recognition (SER) performance, reaching unprecedented levels. However, obtaining sufficient amounts of accurately labeled data for training or fine-tuning the models remains a costly and challenging task. In this paper, we propose a multi-view SSL pre-training technique that can be applied to various representations of speech, including the ones generated by large speech models, to improve SER performance in scenarios where annotations are limited. Our experiments, based on wav2vec 2.0, spectral and paralinguistic features, demonstrate that the proposed framework boosts the SER performance, by up to 10% in Unweighted Average Recall, in settings with extremely sparse data annotations.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningEmotion RecognitionSelf-Supervised LearningSpeech Emotion RecognitionSimilar Papers 제목 키워드 기반
Exploring Localization for Self-supervised Fine-grained Contrastive Learning
Self-supervised contrastive learning has demonstrated great potential in learning visual representations. Despite their success in various downstream tasks such as image classification and object detection, self-supervis…
Contrastive LearningFine-Grained Image ClassificationFine-Grained Image Recognitionimage-classification+2Multi-level Cross-view Contrastive Learning for Knowledge-aware Recommender System
Knowledge graph (KG) plays an increasingly important role in recommender systems. Recently, graph neural networks (GNNs) based model has gradually become the theme of knowledge-aware recommendation (KGR). However, there …
Contrastive LearningData Augmentationgraph constructionKnowledge-Aware Recommendation+1Cross-View-Prediction: Exploring Contrastive Feature for Hyperspectral Image Classification
This paper presents a self-supervised feature learning method for hyperspectral image classification. Our method tries to construct two different views of the raw hyperspectral image through a cross-representation learni…
Contrastive LearningHyperspectral Image Classificationimage-classificationImage Classification+1Generalizing Supervised Contrastive learning: A Projection Perspective
Self-supervised contrastive learning (SSCL) has emerged as a powerful paradigm for representation learning and has been studied from multiple perspectives, including mutual information and geometric viewpoints. However, …
Contrastive LearningRepresentation LearningvalidImproving Knowledge-aware Recommendation with Multi-level Interactive Contrastive Learning
Incorporating Knowledge Graphs (KG) into recommeder system has attracted considerable attention. Recently, the technical trend of Knowledge-aware Recommendation (KGR) is to develop end-to-end models based on graph neural…
Contrastive LearningKnowledge-Aware RecommendationKnowledge GraphsRepresentation Learning+1