paper-with-me

홈 › Papers

A Two-Level Interpretation of Modality in Human-Robot Dialogue

2020-12-01 · COLING 2020 8 · Lucia Donatelli, Kenneth Lai, James Pustejovsky

We analyze the use and interpretation of modal expressions in a corpus of situated human-robot dialogue and ask how to effectively represent these expressions for automatic learning. We present a two-level annotation scheme for modality that captures both content and intent, integrating a logic-based, semantic representation and a task-oriented, pragmatic representation that maps to our robot{'}s capabilities. Data from our annotation task reveals that the interpretation of modal expressions in human-robot dialogue is quite diverse, yet highly constrained by the physical environment and asymmetrical speaker/addressee relationship. We sketch a formal model of human-robot common ground in which modality can be grounded and dynamically interpreted.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Vocal Bursts Valence Prediction

Similar Papers 제목 키워드 기반

Multi-Turn Multi-Agent Dialogue for Collaborative Reconstruction Improves VLM Performance on Spatial Reasoning, But Only Barely

2026-05-29 · Chalamalasetti Kranti, Sherzod Hakimov, David Schlangen arxiv

Robots operating in diverse environments rely on visual input to interpret objects and spatial layouts. In human-collaborative tasks, they are expected to communicate this understanding through language. Vision-language …

Instruction FollowingQuestion AnsweringSpatial Reasoning

A Taxonomy of Conceptual Alignment in Human-Robot Dialogue

2026-06-21 · Shengchen Zhang, Xiaohua Sun, Weiwei Guo arxiv

Successful conversations require speakers to align on the meaning of concepts, a challenging but crucial task for human-robot interaction. Understanding the process of establishing such alignment is hindered by competing…

Dialogue Corpus Construction Considering Modality and Social Relationships in Building Common Ground

2022-06-01 · LREC 2022 6 · Yuki Furuya, Koki Saito, Kosuke Ogura, Koh Mitsuda 외

Building common ground with users is essential for dialogue agent systems and robots to interact naturally with people. While a few previous studies have investigated the process of building common ground in human-human …

Predicting Perceived Age: Both Language Ability and Appearance are Important

2018-07-01 · WS 2018 7 · Sarah Plane, Ariel Marvasti, Tyler Egan, Casey Kennington

When interacting with robots in a situated spoken dialogue setting, human dialogue partners tend to assign anthropomorphic and social characteristics to those robots. In this paper, we explore the age and educational lev…

Language Acquisition

Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction

2024-06-18 · Haoqiu Yan, Yongxin Zhu, Kai Zheng, Bing Liu 외

Large Language Model (LLM)-enhanced agents become increasingly prevalent in Human-AI communication, offering vast potential from entertainment to professional domains. However, current multi-modal dialogue systems overlo…

Language ModelingLanguage ModellingLarge Language Model