Papers Visual Dialog
“Visual Dialog” 태그가 달린 논문 120편 · 필터 해제
Ensemble based discriminative models for Visual Dialog Challenge 2018
This manuscript describes our approach for the Visual Dialog Challenge 2018. We use an ensemble of three discriminative models with different encoders and decoders for our final submission. Our best performing model on '…
PositionVisual DialogVision and Language: from Visual Perception to Content Creation
Vision and language are two fundamental capabilities of human intelligence. Humans routinely perform tasks through the interactions between vision and language, supporting the uniquely human capacity to talk about what t…
DecoderQuestion AnsweringvalidVideo Captioning+3DMRM: A Dual-channel Multi-hop Reasoning Model for Visual Dialog
Visual Dialog is a vision-language task that requires an AI agent to engage in a conversation with humans grounded in an image. It remains a challenging task since it requires the agent to fully understand a given questi…
AI AgentDecoderMultimodal ReasoningVisual DialogLarge-scale Pretraining for Visual Dialog: A Simple State-of-the-Art Baseline
Prior work in visual dialog has focused on training deep neural models on VisDial in isolation. Instead, we present an approach to leverage pretraining on related vision-language datasets before transferring to visual di…
Language ModellingRepresentation LearningVisual DialogVisual Question AnsweringTAB-VCR: Tags and Attributes based VCR Baselines
Reasoning is an important ability that we learn from a very early age. Yet, reasoning is extremely hard for algorithms. Despite impressive recent progress that has been reported on tasks that necessitate reasoning, such …
AttributeQuestion AnsweringVisual Commonsense ReasoningVisual Dialog+2Efficient Attention Mechanism for Visual Dialog that can Handle All the Interactions between Multiple Inputs
It has been a primary concern in recent studies of vision and language tasks to design an effective attention mechanism dealing with interactions between the two modalities. The Transformer has recently been extended and…
AllVisual DialogTwo Causal Principles for Improving Visual Dialog
This paper unravels the design tricks adopted by us, the champion team MReaL-BDAI, for Visual Dialog Challenge 2019: two causal principles for improving Visual Dialog (VisDial). By "improving", we mean that they can prom…
Visual DialogVocal Bursts Valence PredictionAn Annotated Corpus of Reference Resolution for Interpreting Common Grounding
Common grounding is the process of creating, repairing and updating mutual understandings, which is a fundamental aspect of natural language conversation. However, interpreting the process of common grounding is a challe…
Coreference ResolutionGoal-Oriented DialogNatural Language UnderstandingVisual DialogDualVD: An Adaptive Dual Encoding Model for Deep Visual Understanding in Visual Dialogue
Different from Visual Question Answering task that requires to answer only one question about an image, Visual Dialogue involves multiple questions which cover a broad range of visual content that could be related to any…
feature selectionQuestion AnsweringVisual DialogVisual Question Answering+1Visual Dialogue State Tracking for Question Generation
GuessWhat?! is a visual dialogue task between a guesser and an oracle. The guesser aims to locate an object supposed by the oracle oneself in an image by asking a sequence of Yes/No questions. Asking proper questions wit…
Dialogue State TrackingQuestion GenerationQuestion-GenerationVisual DialogVideo Dialog via Progressive Inference and Cross-Transformer
Video dialog is a new and challenging task, which requires the agent to answer questions combining video information with dialog history. And different from single-turn video question answering, the additional dialog his…
Answer GenerationQuestion AnsweringQuestion GenerationQuestion-Generation+2TAB-VCR: Tags and Attributes based Visual Commonsense Reasoning Baselines
Reasoning is an important ability that we learn from a very early age. Yet, reasoning is extremely hard for algorithms. Despite impressive recent progress that has been reported on tasks that necessitate reasoning, such …
AttributeQuestion AnsweringVisual Commonsense ReasoningVisual Dialog+2Granular Multimodal Attention Networks for Visual Dialog
Vision and language tasks have benefited from attention. There have been a number of different attention models proposed. However, the scale at which attention needs to be applied has not been well examined. Particularly…
Visual DialogImproving Generative Visual Dialog by Answering Diverse Questions
Prior work on training generative Visual Dialog models with reinforcement learning(Das et al.) has explored a Qbot-Abot image-guessing game and shown that this 'self-talk' approach can lead to improved performance at the…
Reinforcement LearningRepresentation LearningVisual DialogOn Controlled DeEntanglement for Natural Language Processing
Latest addition to the toolbox of human species is Artificial Intelligence(AI). Thus far, AI has made significant progress in low stake low risk scenarios such as playing Go and we are currently in a transition toward me…
Visual DialogProbabilistic framework for solving Visual Dialog
In this paper, we propose a probabilistic framework for solving the task of `Visual Dialog'. Solving this task requires reasoning and understanding of visual modality, language modality, and common sense knowledge to ans…
Common Sense ReasoningVisual DialogBuilding Task-Oriented Visual Dialog Systems Through Alternative Optimization Between Dialog Policy and Language Generation
Reinforcement learning (RL) is an effective approach to learn an optimal dialog policy for task-oriented visual dialog systems. A common practice is to apply RL on a neural sequence-to-sequence (seq2seq) framework with t…
DecoderReinforcement LearningReinforcement Learning (RL)Text Generation+1Grounded Agreement Games: Emphasizing Conversational Grounding in Visual Dialogue Settings
Where early work on dialogue in Computational Linguistics put much emphasis on dialogue structure and its relation to the mental states of the dialogue participants (e.g., Allen 1979, Grosz & Sidner 1986), current work m…
ChatbotVisual DialogReactive Multi-Stage Feature Fusion for Multimodal Dialogue Modeling
Visual question answering and visual dialogue tasks have been increasingly studied in the multimodal field towards more practical real-world scenarios. A more challenging task, audio visual scene-aware dialogue (AVSD), i…
Question AnsweringScene-Aware DialogueVisual DialogVisual Question Answering+1What Should I Ask? Using Conversationally Informative Rewards for Goal-Oriented Visual Dialog
The ability to engage in goal-oriented conversations has allowed humans to gain knowledge, reduce uncertainty, and perform tasks more efficiently. Artificial agents, however, are still far behind humans in having goal-dr…
Reinforcement LearningVisual Dialog