paper-with-me

홈 › Papers

Are Gestures Worth a Thousand Words? An Analysis of Interviews in the Political Domain

2021-06-01 · ACL (mmsr, IWCS) 2021 6 · Daniela Trotta, Sara Tonelli

Speaker gestures are semantically co-expressive with speech and serve different pragmatic functions to accompany oral modality. Therefore, gestures are an inseparable part of the language system: they may add clarity to discourse, can be employed to facilitate lexical retrieval and retain a turn in conversations, assist in verbalizing semantic content and facilitate speakers in coming up with the words they intend to say. This aspect is particularly relevant in political discourse, where speakers try to apply communication strategies that are both clear and persuasive using verbal and non-verbal cues. In this paper we investigate the co-speech gestures of several Italian politicians during face-to-face interviews using a multimodal linguistic approach. We first enrich an existing corpus with a novel annotation layer capturing the function of hand movements. Then, we perform an analysis of the corpus, focusing in particular on the relationship between hand movements and other information layers such as the political party or non-lexical and semi-lexical tags. We observe that the recorded differences pertain more to single politicians than to the party they belong to, and that hand movements tend to occur frequently with semi-lexical phenomena, supporting the lexical retrieval hypothesis.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Retrieval

Similar Papers 제목 키워드 기반

Identity-free Artificial Emotional Intelligence via Micro-Gesture Understanding

2024-05-21 · Rong Gao, Xin Liu, Bohao Xing, Zitong Yu 외

In this work, we focus on a special group of human body language -- the micro-gesture (MG), which differs from the range of ordinary illustrative gestures in that they are not intentional behaviors performed to convey in…

Action RecognitionDeception DetectionEmotional IntelligenceGesture Recognition+1

Adding Gesture, Posture and Facial Displays to the PoliModal Corpus of Political Interviews

2020-05-01 · LREC 2020 5 · Daniela Trotta, Alessio Palmero Aprosio, Sara Tonelli, Annibale Elia

This paper introduces a multimodal corpus in the political domain, which on top of transcribed face-to-face interviews presents the annotation of facial displays, hand gestures and body posture. While the fully annotated…

GesGPT: Speech Gesture Synthesis With Text Parsing from ChatGPT

2023-03-23 · Nan Gao, Zeyu Zhao, Zhi Zeng, Shuwu Zhang 외

Gesture synthesis has gained significant attention as a critical research field, aiming to produce contextually appropriate and natural gestures corresponding to speech or textual input. Although deep learning-based appr…

Gesture Generation

GestureLens: Visual Analysis of Gestures in Presentation Videos

2022-04-19 · Haipeng Zeng, Xingbo Wang, Yong Wang, Aoyu Wu 외

Appropriate gestures can enhance message delivery and audience engagement in both daily communication and public presentations. In this paper, we contribute a visual analytic approach that assists professional public spe…

Quantitative analysis of robot gesticulation behavior

2020-10-22 · Unai Zabala, Igor Rodriguez, José María Martínez-Otzeta, Itziar Irigoien 외

Social robot capabilities, such as talking gestures, are best produced using data driven approaches to avoid being repetitive and to show trustworthiness. However, there is a lack of robust quantitative methods that allo…

Gesture Generation