Resolving Language and Vision Ambiguities Together: Joint Segmentation \& Prepositional Attachment Resolution in Captioned Scenes
Code (0)
등록된 구현이 없습니다.
Tasks
Common Sense ReasoningPrepositional Phrase AttachmentSemantic SegmentationSimilar Papers 제목 키워드 기반
Resolving Language and Vision Ambiguities Together: Joint Segmentation & Prepositional Attachment Resolution in Captioned Scenes
We present an approach to simultaneously perform semantic segmentation and prepositional phrase attachment resolution for captioned images. Some ambiguities in language cannot be resolved without simultaneously reasoning…
Common Sense ReasoningPrepositional Phrase AttachmentSegmentationSemantic Segmentation+1Teaching Vision-Language Models to Ask: Resolving Ambiguity in Visual Questions
In visual question answering (VQA) context, users often pose ambiguous questions to visual language models (VLMs) due to varying expression habits. Existing research addresses such ambiguities primarily by rephrasing que…
Visual Question AnsweringIs the Elephant Flying? Resolving Ambiguities in Text-to-Image Generative Models
Natural language often contains ambiguities that can lead to misinterpretation and miscommunication. While humans can handle ambiguities effectively by asking clarifying questions and/or relying on contextual cues and co…
Common Sense ReasoningDo Vision-Language Models Represent Space and How? Evaluating Spatial Frame of Reference Under Ambiguities
Spatial expressions in situated communication can be ambiguous, as their meanings vary depending on the frames of reference (FoR) adopted by speakers and listeners. While spatial language understanding and reasoning by v…
Spatial ReasoningVisually Guided Spatial Relation Extraction from Text
Extraction of spatial relations from sentences with complex/nesting relationships is very challenging as often needs resolving inherent semantic ambiguities. We seek help from visual modality to fill the information gap …
Activity RecognitionImage CaptioningImage RetrievalObject Localization+4