Papers Visual Dialog
“Visual Dialog” 태그가 달린 논문 120편 · 필터 해제
Enhancing Visual Dialog Questioner with Entity-based Strategy Learning and Augmented Guesser
Considering the importance of building a good Visual Dialog (VD) Questioner, many researchers study the topic under a Q-Bot-A-Bot image-guessing game setting, where the Questioner needs to raise a series of questions to …
DiversityReinforcement Learning (RL)Visual DialogSeqDialN: Sequential Visual Dialog Network in Joint Visual-Linguistic Representation Space
The key challenge of the visual dialog task is how to fuse features from multimodal sources and extract relevant information from dialog history to answer the current query. In this work, we formulate a visual dialog as …
Visual DialogLearning Better Visual Dialog Agents with Pretrained Visual-Linguistic Representation
GuessWhat?! is a two-player visual dialog guessing game where player A asks a sequence of yes/no questions (Questioner) and makes a final guess (Guesser) about a target object in an image, based on answers from player B …
Referring ExpressionReferring Expression ComprehensionVisual DialogVisual GroundingEnsemble of MRR and NDCG models for Visual Dialog
Assessing an AI agent that can converse in human language and understand visual content is challenging. Generation metrics, such as BLEU scores favor correct syntax over semantics. Hence a discriminative approach is ofte…
AI AgentVisual DialogVisual-Textual Alignment for Graph Inference in Visual Dialog
As a conversational intelligence task, visual dialog entails answering a series of questions grounded in an image, using the dialog history as context. To generate correct answers, the comprehension of the semantic depen…
Visual DialogWhere Are You? Localization from Embodied Dialog
We present Where Are You? (WAY), a dataset of ~6k dialogs in which two humans -- an Observer and a Locator -- complete a cooperative localization task. The Observer is spawned at random in a 3D environment and can naviga…
NavigateVisual DialogReasoning Over History: Context Aware Visual Dialog
While neural models have been shown to exhibit strong performance on single-turn visual question answering (VQA) tasks, extending VQA to a multi-turn, conversational setting remains a challenge. One way to address this c…
coreference-resolutionCoreference ResolutionQuestion AnsweringVisual Dialog+2Multi-Modal Open-Domain Dialogue
Recent work in open-domain conversational agents has demonstrated that significant improvements in model engagingness and humanness metrics can be achieved via massive scaling in both pre-training data and model size (Ad…
Visual DialogAnswer-Driven Visual State Estimator for Goal-Oriented Visual Dialogue
A goal-oriented visual dialogue involves multi-turn interactions between two agents, Questioner and Oracle. During which, the answer given by Oracle is of great significance, as it provides golden response to what Questi…
Question GenerationQuestion-GenerationState EstimationVisual DialogSeqDialN: Sequential Visual Dialog Networks in Joint Visual-Linguistic Representation Space
In this work, we formulate a visual dialog as an information flow in which each piece of information is encoded with the joint visual-linguistic representation of a single dialog round. Based on this formulation, we cons…
Visual DialogDialog without Dialog Data: Learning Visual Dialog Agents from VQA Data
Can we develop visually grounded dialog agents that can efficiently adapt to new tasks without forgetting how to talk to people? Such agents could leverage a larger variety of existing data to generalize to new tasks, mi…
Visual DialogVisual Question Answering (VQA)Towards Visual Dialog for Radiology
Current research in machine learning for radiology is focused mostly on images. There exists limited work in investigating intelligent interactive systems for radiology. To address this limitation, we introduce a realist…
Question AnsweringVisual DialogVisual Question AnsweringVisual Question Answering (VQA)Effective questions in referential visual dialogue
An interesting challenge for situated dialogue systems is referential visual dialog: by asking questions, the system has to identify the referent to which the user refers to. Task success is the standard metric used to e…
Visual DialogORD: Object Relationship Discovery for Visual Dialogue Generation
With the rapid advancement of image captioning and visual question answering at single-round level, the question of how to generate multi-round dialogue about visual content has not yet been well explored.Existing visual…
Dialogue GenerationGraph AttentionImage CaptioningObject+4History for Visual Dialog: Do we really need it?
Visual Dialog involves "understanding" the dialog history (what has been discussed previously) and the current question (what is asked), in addition to grounding information in the image, to generate the correct response…
Visual DialogMulti-View Attention Network for Visual Dialog
Visual dialog is a challenging vision-language task in which a series of questions visually grounded by a given image are answered. To resolve the visual dialog task, a high-level understanding of various multimodal inpu…
Visual DialogVD-BERT: A Unified Vision and Dialog Transformer with BERT
Visual dialog is a challenging vision-language task, where a dialog agent needs to answer a series of questions through reasoning on the image content and dialog history. Prior work has mostly focused on various attentio…
Answer GenerationVisual DialogReasoning Visual Dialog with Sparse Graph Learning and Knowledge Transfer
Visual dialog is a task of answering a sequence of questions grounded in an image using the previous dialog history as context. In this paper, we study how to address two fundamental challenges for this task: (1) reasoni…
Graph LearningGraph structure learningTransfer LearningVisual DialogIterative Context-Aware Graph Inference for Visual Dialog
Visual dialog is a challenging task that requires the comprehension of the semantic dependencies among implicit visual and textual contexts. This task can refer to the relation inference in a graphical model with sparse …
Graph AttentionGraph EmbeddingRelationVisual DialogModality-Balanced Models for Visual Dialogue
The Visual Dialog task requires a model to exploit both image and conversational context information to generate the next response to the dialogue. However, via manual analysis, we find that a large number of conversatio…
Visual Dialog