Creating a Corpus of Gestures and Predicting the Audience Response based on Gestures in Speeches of Donald Trump
Gestures are an important component of non{--}verbal communication. This has an increasing potential in human{--}computer interaction. For example, Navarretta (2017b) uses sequences of speech and pauses together with co{--}speech gestures produced by Barack Obama in order to predict audience response, such as applause. The aim of this study is to explore the role of speech pauses and gestures alone as predictors of audience reaction without other types of speech information. For this work, we created a corpus of speeches held by Donald Trump before and during his time as president between 2016 and 2019. The data were transcribed with pause information and co{--}speech gestures were annotated as well as audience responses. Gestures and long silent pauses of the duration of at least 0.5 seconds are the input of computational models to predict audience reaction. The results of this study indicate that especially head movements and facial expressions play an important role and they confirm that gestures can to some extent be used to predict audience reaction independently of speech.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Supporting Comedy Writers: Predicting Audience’s Response from Sketch Comedy and Crosstalk Scripts
Sketch comedy and crosstalk are two popular types of comedy. They can relieve people’s stress and thus benefit their mental health, especially when performances and scripts are high-quality. However, writing a script is …
text-classificationText ClassificationFinding Recurrent Features of Image Schema Gestures: the FIGURE corpus
The Frankfurt Image GestURE corpus (FIGURE) is introduced. The corpus data is collected in an experimental setting where 50 naive participants spontaneously produced gestures in response to five to six terms from a total…
DescriptiveFinding Common Ground: Annotating and Predicting Common Ground in Spoken Conversations
When we communicate with other humans, we do not simply generate a sequence of words. Rather, we use our cognitive state (beliefs, desires, intentions) and our model of the audience's cognitive state to create utterances…
Dual-Model Prediction of Affective Engagement and Vocal Attractiveness from Speaker Expressiveness in Video Learning
This paper outlines a machine learning-enabled speaker-centric Emotion AI approach capable of predicting audience-affective engagement and vocal attractiveness in asynchronous video-based learning, relying solely on spea…
DEGELS1: A comparable corpus of French Sign Language and co-speech gestures
In this paper, we describe DEGELS1, a comparable corpus of French Sign Language and co-speech gestures that has been created to serve as a testbed corpus for the DEGELS workshops. These workshop series were initiated in …