Papers Visual Dialog
“Visual Dialog” 태그가 달린 논문 120편 · 필터 해제
Visual Coreference Resolution in Visual Dialog using Neural Module Networks
Visual dialog entails answering a series of questions grounded in an image, using dialog history as context. In addition to the challenges found in visual question answering (VQA), which can be seen as one-round dialog, …
Common Sense Reasoningcoreference-resolutionCoreference ResolutionVisual Dialog+3Visual Reasoning with Multi-hop Feature Modulation
Recent breakthroughs in computer vision and natural language processing have spurred interest in challenging multi-modal tasks such as visual question-answering and visual dialogue. For such tasks, one successful approac…
Question AnsweringVisual DialogVisual Question AnsweringVisual Question Answering (VQA)+1Learning Goal-Oriented Visual Dialog via Tempered Policy Gradient
Learning goal-oriented dialogues by means of deep reinforcement learning has recently become a popular research topic. However, commonly used policy-based dialogue agents often end up focusing on simple utterances and su…
Deep Reinforcement LearningPolicy Gradient MethodsReinforcement LearningReinforcement Learning (RL)+1Pushing the Limits of Radiology with Joint Modeling of Visual and Textual Information
Recently, there has been increasing interest in the intersection of computer vision and natural language processing. Researchers have studied several interesting tasks, including generating text descriptions from images …
Image ClassificationMachine TranslationObject DetectionQuestion Answering+5Connecting Language and Vision to Actions
A long-term goal of AI research is to build intelligent agents that can see the rich visual environment around us, communicate this understanding in natural language to humans and other agents, and act in a physical or e…
Image CaptioningLanguage ModelingLanguage ModellingQuestion Answering+3Audio Visual Scene-Aware Dialog (AVSD) Challenge at DSTC7
Scene-aware dialog systems will be able to have conversations with users about the objects and events around them. Progress on such systems can be made by integrating state-of-the-art technologies from multiple research …
Video DescriptionVisual DialogAsk No More: Deciding when to guess in referential visual dialogue
Our goal is to explore how the abilities brought in by a dialogue manager can be included in end-to-end visually grounded conversational agents. We make initial steps towards this general goal by augmenting a task-orient…
Decision MakingVisual DialogMultimodal Hierarchical Reinforcement Learning Policy for Task-Oriented Visual Dialog
Creating an intelligent conversational system that understands vision and language is one of the ultimate goals in Artificial Intelligence (AI)~\cite{winograd1972understanding}. Extensive research has focused on vision-t…
Hierarchical Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)+2Dialog-based Interactive Image Retrieval
Existing methods for interactive image retrieval have demonstrated the merit of integrating user feedback, improving retrieval results. However, most current systems rely on restricted forms of user feedback, such as bin…
Image Retrievalreinforcement-learningReinforcement LearningReinforcement Learning (RL)+2Two can play this Game: Visual Dialog with Discriminative Question Generation and Answering
Human conversation is a complex mechanism with subtle nuances. It is hence an ambitious goal to develop artificial intelligence agents that can participate fluently in a conversation. While we are still far from achievin…
Image CaptioningQuestion AnsweringQuestion GenerationQuestion-Generation+3Answerer in Questioner's Mind: Information Theoretic Approach to Goal-Oriented Visual Dialog
Goal-oriented dialog has been given attention due to its numerous applications in artificial intelligence. Goal-oriented dialogue tasks occur when a questioner asks an action-oriented question and an answerer responds wi…
Goal-Oriented DialogReinforcement LearningVisual DialogFlipDial: A Generative Model for Two-Way Visual Dialogue
We present FlipDial, a generative model for visual dialogue that simultaneously plays the role of both participants in a visually-grounded dialogue. Given context in the form of an image and an associated caption summari…
Visual DialogVocal Bursts Valence PredictionExamining Cooperation in Visual Dialog Models
In this work we propose a blackbox intervention method for visual dialog models, with the aim of assessing the contribution of individual linguistic or visual components. Concretely, we conduct structured or randomized i…
Visual DialogAre You Talking to Me? Reasoned Visual Dialog Generation through Adversarial Learning
The Visual Dialogue task requires an agent to engage in a conversation about an image with a human. It represents an extension of the Visual Question Answering task in that the agent needs to answer a question about an i…
Question AnsweringReinforcement LearningVisual DialogVisual Question Answering+1Visual Reference Resolution using Attention Memory for Visual Dialog
Visual dialog is a task of answering a series of inter-dependent questions given an input image, and often requires to resolve visual references among the questions. This problem is different from visual question answeri…
Parameter PredictionQuestion AnsweringVisual DialogVisual Grounding+2Best of Both Worlds: Transferring Knowledge from Discriminative Learning to a Generative Visual Dialog Model
We present a novel training framework for neural sequence models, particularly for grounded dialog generation. The standard training paradigm for these models is maximum likelihood estimation (MLE), or minimizing the cro…
InformativenessMetric LearningTransfer LearningVisual DialogLearning to Reason: End-to-End Module Networks for Visual Question Answering
Natural language questions are inherently compositional, and many are most easily answered by reasoning about their decomposition into modular sub-problems. For example, to answer "is there an equal number of balls and b…
Visual DialogVisual Question AnsweringVisual Question Answering (VQA)Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learning
We introduce the first goal-driven training for visual question answering and dialog agents. Specifically, we pose a cooperative 'image guessing' game between two agents -- Qbot and Abot -- who communicate in natural lan…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)+3Visual Dialog
We introduce the task of Visual Dialog, which requires an AI agent to hold a meaningful dialog with humans in natural, conversational language about visual content. Specifically, given an image, a dialog history, and a q…
AI AgentChatbotRetrievalVisual DialogHierarchical Question-Image Co-Attention for Visual Question Answering
A number of recent works have proposed attention models for Visual Question Answering (VQA) that generate spatial maps highlighting image regions relevant to answering the question. In this paper, we argue that in additi…
Visual DialogVisual Question AnsweringVisual Question Answering (VQA)