paper-with-me

홈 › Papers

Mining a multimodal corpus for non-verbal behavior sequences conveying attitudes

2014-05-01 · LREC 2014 5 · Mathieu Chollet, Magalie Ochs, Catherine Pelachaud

Interpersonal attitudes are expressed by non-verbal behaviors on a variety of different modalities. The perception of these behaviors is influenced by how they are sequenced with other behaviors from the same person and behaviors from other interactants. In this paper, we present a method for extracting and generating sequences of non-verbal signals expressing interpersonal attitudes. These sequences are used as part of a framework for non-verbal expression with Embodied Conversational Agents that considers different features of non-verbal behavior: global behavior tendencies, interpersonal reactions, sequencing of non-verbal signals, and communicative intentions. Our method uses a sequence mining technique on an annotated multimodal corpus to extract sequences characteristic of different attitudes. New sequences of non-verbal signals are generated using a probabilistic model, and evaluated using the previously mined sequences.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

The Tutorbot Corpus --- A Corpus for Studying Tutoring Behaviour in Multiparty Face-to-Face Spoken Dialogue

2014-05-01 · LREC 2014 5 · Maria Koutsombogera, Samer Al Moubayed, Bajibabu Bollepalli, Ahmed Hussen Abdelaziz 외

This paper describes a novel experimental setup exploiting state-of-the-art capture equipment to collect a multimodally rich game-solving collaborative multiparty dialogue corpus. The corpus is targeted and designed towa…

Spoken Dialogue Systems

Words Can Shift: Dynamically Adjusting Word Representations Using Nonverbal Behaviors

2018-11-23 · Yansen Wang, Ying Shen, Zhun Liu, Paul Pu Liang 외

Humans convey their intentions through the usage of both verbal and nonverbal behaviors during face-to-face communication. Speaker intentions often vary dynamically depending on different nonverbal contexts, such as voca…

Emotion RecognitionMultimodal Sentiment AnalysisSentiment Analysis

Inter-Stance: A Dyadic Multimodal Corpus for Conversational Stance Analysis

2026-04-24 · Xiang Zhang, Xiaotian Li, Taoyue Wang, Nan Bi 외 arxiv

Social interactions dominate our perceptions of the world and shape our daily behavior by attaching social meaning to acts as simple and spontaneous as gestures, facial expressions, voice, and speech. People mimic and ot…

Lexical Retrieval Hypothesis in Multimodal Context

2023-05-28 · Po-Ya Angela Wang, Pin-Er Chen, Hsin-Yu Chou, Yu-Hsiang Tseng 외

Multimodal corpora have become an essential language resource for language science and grounded natural language processing (NLP) systems due to the growing need to understand and interpret human communication across var…

Retrieval

Multilingual Dyadic Interaction Corpus NoXi+J: Toward Understanding Asian-European Non-verbal Cultural Characteristics and their Influences on Engagement

2024-09-09 · Marius Funk, Shogo Okada, Elisabeth André

Non-verbal behavior is a central challenge in understanding the dynamics of a conversation and the affective states between interlocutors arising from the interaction. Although psychological research has demonstrated tha…

Transfer Learning