Multimodal Behaviour and Feedback in Different Types of Interaction
In this article, we compare feedback-related multimodal behaviours in two different types of interactions: first encounters between two participants who do not know each other in advance, and naturally-occurring conversations between two and three participants recorded at their homes. All participants are Danish native speakers. The interactions are transcribed using the same methodology, and the multimodal behaviours are annotated according to the same annotation scheme. In the study we focus on the most frequently occurring feedback expressions in the interactions and on feedback-related head movements and facial expressions. The analysis of the corpora, while confirming general facts about feedback-related head movements and facial expressions previously reported in the literature, also shows that the physical setting, the number of participants, the topics discussed, and the degree of familiarity influence the use of gesture types and the frequency of feedback-related expressions and gestures.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Transfer learning of feedback head expressions in Danish and Polish comparable multimodal corpora
The paper is an investigation of the reusability of the annotations of head movements in a corpus in a language to predict the feedback functions of head movements in a comparable corpus in another language. The two corp…
Transfer LearningThe AICO Multimodal Corpus -- Data Collection and Preliminary Analyses
This paper describes data collection and the first explorative research on the AICO Multimodal Corpus. The corpus contains eye-gaze, Kinect, and video recordings of human-robot and human-human interactions, and was colle…
Pedagogical stances and their multimodal signals.
The paper defines the notion of pedagogical stance, viewed as the type of position taken, the role assumed, the image projected and the types of social behaviours performed by a teacher in her teaching interaction with…
PositionStance DetectionDialogue Act Annotation in a Multimodal Corpus of First Encounter Dialogues
This paper deals with the annotation of dialogue acts in a multimodal corpus of first encounter dialogues, i.e. face-to- face dialogues in which two people who meet for the first time talk with no particular purpose othe…
DescriptiveModelling Adaptive Presentations in Human-Robot Interaction using Behaviour Trees
In dialogue, speakers continuously adapt their speech to accommodate the listener, based on the feedback they receive. In this paper, we explore the modelling of such behaviours in the context of a robot presenting a pai…