The AICO Multimodal Corpus -- Data Collection and Preliminary Analyses
This paper describes data collection and the first explorative research on the AICO Multimodal Corpus. The corpus contains eye-gaze, Kinect, and video recordings of human-robot and human-human interactions, and was collected to study cooperation, engagement and attention of human participants in task-based as well as in chatty type interactive situations. In particular, the goal was to enable comparison between human-human and human-robot interactions, besides studying multimodal behaviour and attention in the different dialogue activities. The robot partner was a humanoid Nao robot, and it was expected that its agent-like behaviour would render humanrobot interactions similar to human-human interaction but also high-light important differences due to the robot{'}s limited conversational capabilities. The paper reports on the preliminary studies on the corpus, concerning the participants{'} eye-gaze and gesturing behaviours,which were chosen as objective measures to study differences in their multimodal behaviour patterns with a human and a robot partner.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
AICoderEval: Improving AI Domain Code Generation of Large Language Models
Automated code generation is a pivotal capability of large language models (LLMs). However, assessing this capability in real-world scenarios remains challenging. Previous methods focus more on low-level code generation,…
Code GenerationImage to texttext-classificationText ClassificationThe ILMT-s2s Corpus ― A Multimodal Interlingual Map Task Corpus
This paper presents the multimodal Interlingual Map Task Corpus (ILMT-s2s corpus) collected at Trinity College Dublin, and discuss some of the issues related to the collection and analysis of the data. The corpus design …
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Machine Translationspeech-recognition+4Human-Centered AI Communication in Co-Creativity: An Initial Framework and Insights
Effective communication between AI and humans is essential for successful human-AI co-creation. However, many current co-creative AI systems lack effective communication, which limits their potential for collaboration. T…
GAICo: A Deployed and Extensible Framework for Evaluating Diverse and Multimodal Generative AI Outputs
The rapid proliferation of Generative AI (GenAI) into diverse, high-stakes domains necessitates robust and reproducible evaluation methods. However, practitioners often resort to ad-hoc, non-standardized scripts, as comm…
AICOM-MP: an AI-based Monkeypox Detector for Resource-Constrained Environments
Under the Autonomous Mobile Clinics (AMCs) initiative, we are developing, open sourcing, and standardizing health AI technologies to enable healthcare access in least developed countries (LDCs). We deem AMCs as the next …