Automatic identification of head movements in video-recorded conversations: can words help?
We present an approach where an SVM classifier learns to classify head movements based on measurements of velocity, acceleration, and the third derivative of position with respect to time, jerk. Consequently, annotations of head movements are added to new video data. The results of the automatic annotation are evaluated against manual annotations in the same data and show an accuracy of 68{\%} with respect to these. The results also show that using jerk improves accuracy. We then conduct an investigation of the overlap between temporal sequences classified as either movement or non-movement and the speech stream of the person performing the gesture. The statistics derived from this analysis show that using word features may help increase the accuracy of the model.
Code (0)
등록된 구현이 없습니다.
Tasks
PositionTemporal SequencesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Towards a Methodology Supporting Semiautomatic Annotation of HeadMovements in Video-recorded Conversations
We present a method to support the annotation of head movements in video-recorded conversations. Head movement segments from annotated multimodal data are used to train a model to detect head movements in unseen data. Th…
Automatic Detection and Classification of Head Movements in Face-to-Face Conversations
This paper presents an approach to automatic head movement detection and classification in data from a corpus of video-recorded face-to-face conversations in Danish involving 12 different speakers. A number of classifier…
General ClassificationThe influence of labeling techniques in classifying human manipulation movement of different speed
In this work, we investigate the influence of labeling methods on the classification of human movements on data recorded using a marker-based motion capture system. The dataset is labeled using two different approaches, …
Twente Debate Corpus --- A Multimodal Corpus for Head Movement Analysis
This paper introduces a multimodal discussion corpus for the study into head movement and turn-taking patterns in debates. Given that participants either acted alone or in a pair, cooperation and competition and their no…
Emotion pattern detection on facial videos using functional statistics
There is an increasing scientific interest in automatically analysing and understanding human behavior, with particular reference to the evolution of facial expressions and the recognition of the corresponding emotions. …
Emotion Recognition