paper-with-me

홈 › Papers

Improving Personalisation in Valence and Arousal Prediction using Data Augmentation

2024-04-13 · Munachiso Nwadike, Jialin Li, Hanan Salam

In the field of emotion recognition and Human-Machine Interaction (HMI), personalised approaches have exhibited their efficacy in capturing individual-specific characteristics and enhancing affective prediction accuracy. However, personalisation techniques often face the challenge of limited data for target individuals. This paper presents our work on an enhanced personalisation strategy, that leverages data augmentation to develop tailored models for continuous valence and arousal prediction. Our proposed approach, Distance Weighting Augmentation (DWA), employs a weighting-based augmentation method that expands a target individual's dataset, leveraging distance metrics to identify similar samples at the segment-level. Experimental results on the MuSe-Personalisation 2023 Challenge dataset demonstrate that our method significantly improves the performance of features sets which have low baseline performance, on the test set. This improvement in poor-performing features comes without sacrificing performance on high-performing features. In particular, our method achieves a maximum combined testing CCC of 0.78, compared to the reported baseline score of 0.76 (reproduced at 0.72). It also achieved a peak arousal and valence scores of 0.81 and 0.76, compared to reproduced baseline scores of 0.76 and 0.67 respectively. Through this work, we make significant contributions to the advancement of personalised affective computing models, enhancing the practicality and adaptability of data-level personalisation in real world contexts.

📄 PDF Abstract BibTeX arXiv:2404.09042

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationEmotion Recognition

Similar Papers 제목 키워드 기반

Exploiting Diverse Feature for Multimodal Sentiment Analysis

2023-08-25 · Jia Li, Wei Qian, Kun Li, Qi Li 외

In this paper, we present our solution to the MuSe-Personalisation sub-challenge in the MuSe 2023 Multimodal Sentiment Analysis Challenge. The task of MuSe-Personalisation aims to predict the continuous arousal and valen…

Multimodal Sentiment AnalysisSentiment Analysis

The MuSe 2023 Multimodal Sentiment Analysis Challenge: Mimicked Emotions, Cross-Cultural Humour, and Personalisation

2023-05-05 · Lukas Christ, Shahin Amiriparian, Alice Baird, Alexander Kathan 외

The MuSe 2023 is a set of shared tasks addressing three different contemporary multimodal affect and sentiment analysis problems: In the Mimicked Emotions Sub-Challenge (MuSe-Mimic), participants predict three continuous…

Emotion RecognitionMultimodal Sentiment AnalysisSentiment Analysis

MMVA: Multimodal Matching Based on Valence and Arousal across Images, Music, and Musical Captions

2025-01-02 · Suhwan Choi, Kyu Won Kim, Myungjoo Kang

We introduce Multimodal Matching based on Valence and Arousal (MMVA), a tri-modal encoder framework designed to capture emotional content across images, music, and musical captions. To support this framework, we expand t…

Block-Segmentation Vectors for Arousal Prediction using Semi-supervised Learning

2022-04-11 · Yuki Odaka, Ken Kaneiwa

To handle emotional expressions in computer applications, Russell's circum- plex model has been useful for representing emotions according to valence and arousal. In SentiWordNet, the level of valence is automatically as…

Prediction

Multimodal Emotion Recognition for One-Minute-Gradual Emotion Challenge

2018-05-03 · Ziqi Zheng, Chenjie Cao, Xingwei Chen, Guoqiang Xu

The continuous dimensional emotion modelled by arousal and valence can depict complex changes of emotions. In this paper, we present our works on arousal and valence predictions for One-Minute-Gradual (OMG) Emotion Chall…

Emotion RecognitionMultimodal Emotion Recognition