VISALOGY: Answering Visual Analogy Questions
In this paper, we study the problem of answering visual analogy questions. These questions take the form of image A is to image B as image C is to what. Answering these questions entails discovering the mapping from image A to image B and then extending the mapping to image C and searching for the image D such that the relation from A to B holds for C to D. We pose this problem as learning an embedding that encourages pairs of analogous images with similar transformations to be close together using convolutional neural networks with a quadruple Siamese architecture. We introduce a dataset of visual analogy questions in natural images, and show first results of its kind on solving analogy questions on natural images.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Traversal-Free Word Vector Evaluation in Analogy Space
In this paper, we propose an alternative evaluating metric for word analogy questions (A to B is as C to D) in word vector evaluation. Different from the traditional method which predicts the fourth word by the given thr…
Unanswerable Questions about Images and Texts
Questions about a text or an image that cannot be answered raise distinctive issues for an AI. This note discusses the problem of unanswerable questions in VQA (visual question answering), in QA (visual question answerin…
Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)Can Open Domain Question Answering Systems Answer Visual Knowledge Questions?
The task of Outside Knowledge Visual Question Answering (OKVQA) requires an automatic system to answer natural language questions about pictures and images using external knowledge. We observe that many visual questions,…
Open-Domain Question AnsweringQuestion AnsweringQuestion RewritingVisual Question Answering+1VizWiz Grand Challenge: Answering Visual Questions from Blind People
The study of algorithms to automatically answer visual questions currently is motivated by visual question answering (VQA) datasets constructed in artificial VQA settings. We propose VizWiz, the first goal-oriented VQA d…
Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)Recall and Learn: A Memory-augmented Solver for Math Word Problems
In this article, we tackle the math word problem, namely, automatically answering a mathematical problem according to its textual description. Although recent methods have demonstrated their promising results, most of th…
MathMath Word Problem Solving