paper-with-me

Papers

An Efficient Multitask Learning Architecture for Affective Vocal Burst Analysis

2022-09-28 · Tobias Hallmen, Silvan Mertes, Dominik Schiller, Elisabeth André

Affective speech analysis is an ongoing topic of research. A relatively new problem in this field is the analysis of vocal bursts, which are nonverbal vocalisations such as laughs or sighs. Current state-of-the-art approaches to address affective vocal burst analysis are mostly based on wav2vec2 or HuBERT features. In this paper, we investigate the use of the wav2vec successor data2vec in combination with a multitask learning pipeline to tackle different analysis problems at once. To assess the performance of our efficient multitask learning architecture, we participate in the 2022 ACII Affective Vocal Burst Challenge, showing that our approach substantially outperforms the baseline established there in three different subtasks.

📄 PDF Abstract BibTeX arXiv:2209.13914

Code (1)

hcmlab/acii-2022-vb-challenge 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Predicting Affective Vocal Bursts with Finetuned wav2vec 2.0

2022-09-27 · Bagus Tris Atmaja, Akira Sasou

The studies of predicting affective states from human voices have relied heavily on speech. This study, indeed, explores the recognition of humans' affective state from their vocal burst, a short non-verbal vocalization.…

Cultural Vocal Bursts Intensity PredictionSpeech Recognition

Evaluating Variants of wav2vec 2.0 on Affective Vocal Burst Tasks

2023-05-05 · ICASSP 2023 5 · Bagus Tris Atmaja, Akira Sasou

The search for emotional biomarkers within the human voice is a challenging research area. Previous studies focused on predicting affective state from speech; this study explores various tasks on affective vocal bursts. …

Automatic Speech RecognitionCultural Vocal Bursts Intensity PredictionSelf-Supervised Learningspeech-recognition+4

Leveraging Pre-Trained Acoustic Feature Extractor For Affective Vocal Bursts Tasks

2022-12-21 · APSIPA 2022 12 · Bagus Tris Atmaja, Akira Sasou

Understanding humans’ emotions is a challenge for computers. Nowadays, research on speech emotion recognition has been conducted progressively. Instead of a speech, affective information may lay on short vocal bursts (i.…

Emotion RecognitionregressionSelf-Supervised LearningSpeech Emotion Recognition

Fine-tuning Wav2vec for Vocal-burst Emotion Recognition

2022-10-01 · Dang-Khanh Nguyen, Sudarshan Pant, Ngoc-Huynh Ho, Guee-Sang Lee 외

The ACII Affective Vocal Bursts (A-VB) competition introduces a new topic in affective computing, which is understanding emotional expression using the non-verbal sound of humans. We are familiar with emotion recognition…

Emotion Recognition

Self-Supervised Attention Networks and Uncertainty Loss Weighting for Multi-Task Emotion Recognition on Vocal Bursts

2022-09-15 · Vincent Karas, Andreas Triantafyllopoulos, Meishu Song, Björn W. Schuller

Vocal bursts play an important role in communicating affect, making them valuable for improving speech emotion recognition. Here, we present our approach for classifying vocal bursts and predicting their emotional signif…

Emotion RecognitionSpeech Emotion Recognition