Evaluating the Progress of Deep Learning for Visual Relational Concepts
Convolutional Neural Networks (CNNs) have become the state of the art method for image classification in the last ten years. Despite the fact that they achieve superhuman classification accuracy on many popular datasets, they often perform much worse on more abstract image classification tasks. We will show that these difficult tasks are linked to relational concepts from cognitive psychology and that despite progress over the last few years, such relational reasoning tasks still remain difficult for current neural network architectures. We will review deep learning research that is linked to relational concept learning, even if it was not originally presented from this angle. Reviewing the current literature, we will argue that some form of attention will be an important component of future systems to solve relational tasks. In addition, we will point out the shortcomings of currently used datasets, and we will recommend steps to make future datasets more relevant for testing systems on relational reasoning.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationDeep LearningGeneral Classificationimage-classificationImage ClassificationRelational ReasoningSimilar Papers 제목 키워드 기반
Benchmarking and Enhancing Text-to-Image Models for Generating Visual Representations in Early Arithmetic Education
AI systems are increasingly used to support educational content creation, yet it remains unclear whether they can generate outputs that faithfully represent the pedagogical concepts they are intended to teach. Thus, we i…
Image GenerationPix2Code: Learning to Compose Neural Visual Concepts as Programs
The challenge in learning abstract concepts from images in an unsupervised fashion lies in the required integration of visual perception and generalizable relational reasoning. Moreover, the unsupervised nature of this t…
Program SynthesisRelational ReasoningNeural Structure Mapping For Learning Abstract Visual Analogies
Building conceptual abstractions from sensory information and then reasoning about them is central to human intelligence. Abstract reasoning both relies on, and is facilitated by, our ability to make analogies about conc…
Visual AnalogiesVisual ReasoningDEVICE: DEpth and VIsual ConcEpts Aware Transformer for TextCaps
Text-based image captioning is an important but under-explored task, aiming to generate descriptions containing visual objects and scene text. Recent studies have made encouraging progress, but they are still suffering f…
Image CaptioningOptical Character Recognition (OCR)Relational ReasoningImagine, Reason and Write: Visual Storytelling with Graph Knowledge and Relational Reasoning
Visual storytelling is a task of creating a short story based on photo streams. Different from visual captions, stories contain not only factual descriptions, but also imaginary concepts that do not appear in the images.…
DiversityInformativenessRelational ReasoningVisual Storytelling