Papers Visual Dialog
“Visual Dialog” 태그가 달린 논문 120편 · 필터 해제
VD-PCR: Improving Visual Dialog with Pronoun Coreference Resolution
The visual dialog task requires an AI agent to interact with humans in multi-round dialogs based on a visual environment. As a common linguistic phenomenon, pronouns are often used in dialogs to improve the communication…
AI Agentcoreference-resolutionCoreference ResolutionVisual DialogThe Dialog Must Go On: Improving Visual Dialog via Generative Self-Training
Visual dialog (VisDial) is a task of answering a sequence of questions grounded in an image, using the dialog history as context. Prior work has trained the dialog agents solely on VisDial data via supervised learning or…
Conditional Text GenerationOut-of-Distribution DetectionText GenerationVisual DialogUTC: A Unified Transformer with Inter-Task Contrastive Learning for Visual Dialog
Visual Dialog aims to answer multi-round, interactive questions based on the dialog history and image content. Existing methods either consider answer ranking and generating individually or only weakly capture the relati…
Contrastive LearningRepresentation LearningVisual DialogImproving Cross-Modal Understanding in Visual Dialog via Contrastive Learning
Visual Dialog is a challenging vision-language task since the visual dialog agent needs to answer a series of questions after reasoning over both the image content and dialog history. Though existing methods try to deal …
Contrastive LearningQuestion AnsweringVisual DialogVisual Question Answering+1Reasoning with Multi-Structure Commonsense Knowledge in Visual Dialog
Visual Dialog requires an agent to engage in a conversation with humans grounded in an image. Many studies on Visual Dialog focus on the understanding of the dialog history or the content of an image, while a considerabl…
Logical ReasoningSentenceVisual DialogSpot the Difference: A Cooperative Object-Referring Game in Non-Perfectly Co-Observable Scene
Visual dialog has witnessed great progress after introducing various vision-oriented goals into the conversation, especially such as GuessWhich and GuessWhat, where the only image is visible by either and both of the que…
Visual DialogModeling Coreference Relations in Visual Dialog
Visual dialog is a vision-language task where an agent needs to answer a series of questions grounded in an image based on the understanding of the dialog history and the image. The occurrences of coreference relations i…
Question AnsweringVisual DialogVisual Question AnsweringVisual Question Answering (VQA)VU-BERT: A Unified framework for Visual Dialog
The visual dialog task attempts to train an agent to answer multi-turn questions given an image, which requires the deep understanding of interactions between the image and dialog history. Existing researches tend to emp…
Language ModelingLanguage ModellingMasked Language ModelingRetrieval+1Discourse Analysis for Evaluating Coherence in Video Paragraph Captions
Video paragraph captioning is the task of automatically generating a coherent paragraph description of the actions in a video. Previous linguistic studies have demonstrated that coherence of a natural language text is re…
Video CaptioningVisual DialogVisual StorytellingHow to Fool Systems and Humans in Visually Grounded Interaction: A Case Study on Adversarial Attacks on Visual Dialog
Adversarial attacks change predictions of deep neural network models, while aiming to remain unnoticed by the user.This is a challenge for textual attacks, which target discrete text. In this study, we investigate the r…
Visual DialogUNITER-Based Situated Coreference Resolution with Rich Multimodal Input
We present our work on the multimodal coreference resolution task of the Situated and Interactive Multimodal Conversation 2.0 (SIMMC 2.0) dataset as a part of the tenth Dialog System Technology Challenge (DSTC10). We pro…
coreference-resolutionCoreference ResolutionObjectVisual DialogEnriching Language Models with Visually-grounded Word Vectors and the Lancaster Sensorimotor Norms
Language models are trained only on text despite the fact that humans learn their first language in a highly interactive and multimodal environment where the first set of learned words are largely concrete, denoting phys…
Visual DialogRegion under Discussion for visual dialog
Visual Dialog is assumed to require the dialog history to generate correct responses during a dialog. However, it is not clear from previous work how dialog history is needed for visual dialog. In this paper we define wh…
Visual DialogPerceptual Score: What Data Modalities Does Your Model Perceive?
Machine learning advances in the last decade have relied significantly on large-scale datasets that continue to grow in size. Increasingly, those datasets also contain different data modalities. However, large multi-moda…
Question AnsweringVisual DialogVisual Question AnsweringVisual Question Answering (VQA)ViDA-MAN: Visual Dialog with Digital Humans
We demonstrate ViDA-MAN, a digital-human agent for multi-modal interaction, which offers realtime audio-visual responses to instant speech inquiries. Compared to traditional text or voice-based system, ViDA-MAN offers hu…
speech-recognitionSpeech Recognitiontext-to-speechText to Speech+2Evaluating and Improving Interactions with Hazy Oracles
Many AI systems integrate sensor inputs, world knowledge, and human-provided information to perform inference. While such systems often treat the human input as flawless, humans are better thought of as hazy oracles whos…
Object TrackingReferring ExpressionReferring Expression ComprehensionVideo Object Tracking+3The Impact of Answers in Referential Visual Dialog
In the visual dialog task GuessWhat?! two players maintain a dialog in order to identify a secret object in an image. Computationally, this is modeled using a question generation module and a guesser module for the quest…
Question GenerationQuestion-GenerationVisual DialogVariational Disentangled Attention for Regularized Visual Dialog
One of the most important challenges in a visual dialog is to effectively extract the information from a given image and its historical conversation which are related to the current question. Many studies adopt the soft …
Question AnsweringVisual DialogVisual Question AnsweringVisual Question Answering (VQA)GoG: Relation-aware Graph-over-Graph Network for Visual Dialog
Visual dialog, which aims to hold a meaningful conversation with humans about a given image, is a challenging task that requires models to reason the complex dependencies among visual content, dialog history, and current…
coreference-resolutionCoreference ResolutionImplicit RelationsRelation+1Learning to Ground Visual Objects for Visual Dialog
Visual dialog is challenging since it needs to answer a series of coherent questions based on understanding the visual environment. How to ground related visual objects is one of the key problems. Previous studies utiliz…
Visual Dialog