Co-reference via Pointing and Haptics in Multi-Modal Dialogues
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Multimodal Feedback for Handheld Tool Guidance: Combining Wrist-Based Haptics with Augmented Reality
We investigate how vibrotactile wrist feedback can enhance spatial guidance for handheld tool movement in optical see-through augmented reality (AR). While AR overlays are widely used to support surgical tasks, visual oc…
Multimodal Coreference Resolution for Chinese Social Media Dialogues: Dataset and Benchmark Approach
Multimodal coreference resolution (MCR) aims to identify mentions referring to the same entity across different modalities, such as text and visuals, and is essential for understanding multimodal content. In the era of r…
coreference-resolutionCoreference ResolutionMultimodal Driver Referencing: A Comparison of Pointing to Objects Inside and Outside the Vehicle
Advanced in-cabin sensing technologies, especially vision based approaches, have tremendously progressed user interaction inside the vehicle, paving the way for new applications of natural user interaction. Just as human…
Guiding Interaction Behaviors for Multi-modal Grounded Language Learning
Multi-modal grounded language learning connects language predicates to physical properties of objects in the world. Sensing with multiple modalities, such as audio, haptics, and visual colors and shapes while performing …
Grounded language learningRetrievalDisambiguating Reference in Visually Grounded Dialogues through Joint Modeling of Textual and Multimodal Semantic Structures
Multimodal reference resolution, including phrase grounding, aims to understand the semantic relations between mentions and real-world objects. Phrase grounding between images and their captions is a well-established tas…
coreference-resolutionCoreference ResolutionPhrase Grounding