paper-with-me

Papers

Building a Multimodal Laughter Database for Emotion Recognition

2012-05-01 · LREC 2012 5 · Merlin Teodosia Suarez, Jocelynn Cu, Madelene Sta. Maria

Laughter is a significant paralinguistic cue that is largely ignored in multimodal affect analysis. In this work, we investigate how a multimodal laughter corpus can be constructed and annotated both with discrete and dimensional labels of emotions for acted and spontaneous laughter. Professional actors enacted emotions to produce acted clips, while spontaneous laughter was collected from volunteers. Experts annotated acted laughter clips, while volunteers who possess an acceptable empathic quotient score annotated spontaneous laughter clips. The data was pre-processed to remove noise from the environment, and then manually segmented starting from the onset of the expression until its offset. Our findings indicate that laughter carries distinct emotions, and that emotion in laughter is best recognized using audio information rather than facial information. This may be explained by emotion regulation, i.e. laughter is used to suppress or regulate certain emotions. Furthermore, contextual information plays a crucial role in understanding the kind of laughter and emotion in the enactment.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Emotion Recognition

Similar Papers 제목 키워드 기반

Design and Development of Laughter Recognition System Based on Multimodal Fusion and Deep Learning

2024-07-31

This study aims to design and implement a laughter recognition system based on multimodal fusion and deep learning, leveraging image and audio processing technologies to achieve accurate laughter recognition and emotion …

Introducing MULAI: A Multimodal Database of Laughter during Dyadic Interactions

2020-05-01 · LREC 2020 5 · Michel-Pierre Jansen, Khiet P. Truong, Dirk K.J. Heylen, Deniece S. Nazareth

Although laughter has gained considerable interest from a diversity of research areas, there still is a need for laughter specific databases. We present the Multimodal Laughter during Interaction (MULAI) database to stud…

Diversity

Social-MAE: A Transformer-Based Multimodal Autoencoder for Face and Voice

2025-08-24 · Hugo Bohy, Minh Tran, Kevin El Haddad, Thierry Dutoit 외 arxiv

Human social behaviors are inherently multimodal necessitating the development of powerful audiovisual models for their perception. In this paper, we present Social-MAE, our pre-trained audiovisual Masked Autoencoder bas…

Multimodal Emotion Recognition

Do Multimodal Emotion Recognition Models Tackle Ambiguity?

2022-06-01 · PVLAM (LREC) 2022 6 · Hélène Tran, Issam Falih, Xavier Goblet, Engelbert Mephu Nguifo

Most databases used for emotion recognition assign a single emotion to data samples. This does not match with the complex nature of emotions: we can feel a wide range of emotions throughout our lives with varying degrees…

Emotion RecognitionMultimodal Emotion Recognition

A generative framework for conversational laughter: Its 'language model' and laughter sound synthesis

2023-06-06 · Hiroki Mori, Shunya Kimura

As the phonetic and acoustic manifestations of laughter in conversation are highly diverse, laughter synthesis should be capable of accommodating such diversity while maintaining high controllability. This paper proposes…

DiversityLanguage ModelingLanguage Modelling