paper-with-me

Papers

Estimating Presentation Competence using Multimodal Nonverbal Behavioral Cues

2021-05-06 · Ömer Sümer, Cigdem Beyan, Fabian Ruth, Olaf Kramer, Ulrich Trautwein, Enkelejda Kasneci

Public speaking and presentation competence plays an essential role in many areas of social interaction in our educational, professional, and everyday life. Since our intention during a speech can differ from what is actually understood by the audience, the ability to appropriately convey our message requires a complex set of skills. Presentation competence is cultivated in the early school years and continuously developed over time. One approach that can promote efficient development of presentation competence is the automated analysis of human behavior during a speech based on visual and audio features and machine learning. Furthermore, this analysis can be used to suggest improvements and the development of skills related to presentation competence. In this work, we investigate the contribution of different nonverbal behavioral cues, namely, facial, body pose-based, and audio-related features, to estimate presentation competence. The analyses were performed on videos of 251 students while the automated assessment is based on manual ratings according to the T\"ubingen Instrument for Presentation Competence (TIP). Our classification results reached the best performance with early fusion in the same dataset evaluation (accuracy of 71.25%) and late fusion of speech, face, and body pose features in the cross dataset evaluation (accuracy of 78.11%). Similarly, regression results performed the best with fusion strategies.

📄 PDF Abstract BibTeX arXiv:2105.02636

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Nonverbal Immediacy Analysis in Education: A Multimodal Computational Model

2024-07-24 · Uroš Petković, Jonas Frenkel, Olaf Hellwich, Rebecca Lazarides

This paper introduces a novel computational approach for analyzing nonverbal social behavior in educational settings. Integrating multimodal behavioral cues, including facial expressions, gesture intensity, and spatial d…

Generating and Estimating Nonverbal Alphabets for Situated and Multimodal Communications

2017-12-12 · Serhii Hamotskyi, Sergii Stirenko, Yuri Gordienko, Anis Rojbi

In this paper, we discuss the formalized approach for generating and estimating symbols (and alphabets), which can be communicated by the wide range of non-verbal means based on specific user requirements (medium, priori…

BIG-bench Machine Learning

Words Can Shift: Dynamically Adjusting Word Representations Using Nonverbal Behaviors

2018-11-23 · Yansen Wang, Ying Shen, Zhun Liu, Paul Pu Liang 외

Humans convey their intentions through the usage of both verbal and nonverbal behaviors during face-to-face communication. Speaker intentions often vary dynamically depending on different nonverbal contexts, such as voca…

Emotion RecognitionMultimodal Sentiment AnalysisSentiment Analysis

The Nonverbal Syntax Framework: An Evidence-Based Tiered System for Inferring Learner States from Observable Behavioral Cues

2026-04-28 · Sherzod Turaev, Mary John, Jaloliddin Rustamov, Zahiriddin Rustamov 외 arxiv

Understanding learners' cognitive and affective states underpins adaptive educational systems and effective teaching. Although research links nonverbal cues to internal states, no framework calibrates them to evidence. W…

Belief Without Behavior: Measuring the Translation of Theory of Mind into Coordinated Social Action in Vision-Language Models

2026-08-21 · Tonglin Yan, Gregoire Sergeant-Perthuis, David Rudrauf arxiv

Effective social interaction requires agents to translate mental state inferences into coordinated behavioral signals across verbal and nonverbal channels simultaneously. Yet existing benchmarks evaluate theory of mind (…