Solving Visual Analogies Using Neural Algorithmic Reasoning
We consider a class of visual analogical reasoning problems that involve discovering the sequence of transformations by which pairs of input/output images are related, so as to analogously transform future inputs. This program synthesis task can be easily solved via symbolic search. Using a variation of the neural analogical reasoning' approach of (Velickovic and Blundell 2021), we instead search for a sequence of elementary neural network transformations that manipulate distributed representations derived from a symbolic space, to which input images are directly encoded. We evaluate the extent to which our neural reasoning' approach generalizes for images with unseen shapes and positions.
Code (0)
등록된 구현이 없습니다.
Tasks
Program SynthesisVisual AnalogiesSimilar Papers 제목 키워드 기반
Solving ARC visual analogies with neural embeddings and vector arithmetic: A generalized method
Analogical reasoning derives information from known relations and generalizes this information to similar yet unfamiliar situations. One of the first generalized ways in which deep learning models were able to solve verb…
ARCDimensionality ReductionVisual AnalogiesVisual Reasoning+1Are Language Models Puzzle Prodigies? Algorithmic Puzzles Unveil Serious Challenges in Multimodal Reasoning
This paper introduces the novel task of multimodal puzzle solving, framed within the context of visual question-answering. We present a new dataset, AlgoPuzzleVQA designed to challenge and evaluate the capabilities of mu…
Multimodal ReasoningQuestion AnsweringVisual Question AnsweringDeep Visual Analogy-Making
In addition to identifying the content within a single image, relating images and generating related images are critical tasks for image understanding. Recently, deep convolutional networks have yielded breakthroughs in …
Language ModelingLanguage ModellingVisual AnalogiesVisual-Imagery-Based Analogical Construction in Geometric Matrix Reasoning Task
Raven's Progressive Matrices is a family of classical intelligence tests that have been widely used in both research and clinical settings. There have been many exciting efforts in AI communities to computationally model…
Neural Structure Mapping For Learning Abstract Visual Analogies
Building conceptual abstractions from sensory information and then reasoning about them is central to human intelligence. Abstract reasoning both relies on, and is facilitated by, our ability to make analogies about conc…
Visual AnalogiesVisual Reasoning