paper-with-me

홈 › Papers

Multimodal Analysis of Cohesion in Multi-party Interactions

2020-05-01 · LREC 2020 5 · Reshmashree Bangalore Kantharaju, Caroline Langlet, Mukesh Barange, Chlo{\'e} Clavel, Catherine Pelachaud

Group cohesion is an emergent phenomenon that describes the tendency of the group members{'} shared commitment to group tasks and the interpersonal attraction among them. This paper presents a multimodal analysis of group cohesion using a corpus of multi-party interactions. We utilize 16 two-minute segments annotated with cohesion from the AMI corpus. We define three layers of modalities: non-verbal social cues, dialogue acts and interruptions. The initial analysis is performed at the individual level and later, we combine the different modalities to observe their impact on perceived level of cohesion. Results indicate that occurrence of laughter and interruption are higher in high cohesive segments. We also observe that, dialogue acts and head nods did not have an impact on the level of cohesion by itself. However, when combined there was an impact on the perceived level of cohesion. Overall, the analysis shows that multimodal cues are crucial for accurate analysis of group cohesion.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

RoomReader: A Multimodal Corpus of Online Multiparty Conversational Interactions

2022-06-01 · LREC 2022 6 · Justine Reverdy, Sam O’Connor Russell, Louise Duquenne, Diego Garaialde 외

We present RoomReader, a corpus of multimodal, multiparty conversational interactions in which participants followed a collaborative student-tutor scenario designed to elicit spontaneous speech. The corpus was developed …

multimodal interaction

GPolS: A Contextual Graph-Based Language Model for Analyzing Parliamentary Debates and Political Cohesion

2020-12-01 · COLING 2020 8 · Ramit Sawhney, Arnav Wadhwa, Shivam Agarwal, Rajiv Ratn Shah

Parliamentary debates present a valuable language resource for analyzing comprehensive options in electing representatives under a functional, free society. However, the esoteric nature of political speech coupled with n…

Language ModelingLanguage ModellingSentiment Analysis

Modeling Multimodal Social Interactions: New Challenges and Baselines with Densely Aligned Representations

2024-03-04 · CVPR 2024 1 · Sangmin Lee, Bolin Lai, Fiona Ryan, Bikram Boote 외

Understanding social interactions involving both verbal and non-verbal cues is essential for effectively interpreting social situations. However, most prior works on multimodal social cues focus predominantly on single-p…

coreference-resolutionCoreference Resolution

DraDDP: A Multimodal Multi-Party Dialogue Discourse Parsing Dataset

2026-04-13 · Shannan Liu, Peifeng Li, Yaxin Fan, Qiaoming Zhu arxiv

Multi-party dialogue discourse parsing aims to identify dependency structures and relation types between utterances in conversations. Previous studies are mostly limited to textual modality or two-party dialogue, failing…

Discourse Parsing

M3PT: A Transformer for Multimodal, Multi-Party Social Signal Prediction with Person-aware Blockwise Attention

2025-01-23 · Yiming Tang, Abrar Anwar, Jesse Thomason

Understanding social signals in multi-party conversations is important for human-robot interaction and artificial social intelligence. Social signals include body pose, head pose, speech, and context-specific activities …