paper-with-me

홈 › Papers

Evaluating the Progress of Deep Learning for Visual Relational Concepts

2020-01-29 · Sebastian Stabinger, Peer David, Justus Piater, Antonio Rodríguez-Sánchez

Convolutional Neural Networks (CNNs) have become the state of the art method for image classification in the last ten years. Despite the fact that they achieve superhuman classification accuracy on many popular datasets, they often perform much worse on more abstract image classification tasks. We will show that these difficult tasks are linked to relational concepts from cognitive psychology and that despite progress over the last few years, such relational reasoning tasks still remain difficult for current neural network architectures. We will review deep learning research that is linked to relational concept learning, even if it was not originally presented from this angle. Reviewing the current literature, we will argue that some form of attention will be an important component of future systems to solve relational tasks. In addition, we will point out the shortcomings of currently used datasets, and we will recommend steps to make future datasets more relevant for testing systems on relational reasoning.

📄 PDF Abstract BibTeX arXiv:2001.10857

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationDeep LearningGeneral Classificationimage-classificationImage ClassificationRelational Reasoning

Similar Papers 제목 키워드 기반

Benchmarking and Enhancing Text-to-Image Models for Generating Visual Representations in Early Arithmetic Education

2026-05-29 · Junling Wang, Boqi Chen, Heejin Do, Mubashara Akhtar 외 arxiv

AI systems are increasingly used to support educational content creation, yet it remains unclear whether they can generate outputs that faithfully represent the pedagogical concepts they are intended to teach. Thus, we i…

Image Generation

Pix2Code: Learning to Compose Neural Visual Concepts as Programs

2024-02-13 · Antonia Wüst, Wolfgang Stammer, Quentin Delfosse, Devendra Singh Dhami 외

The challenge in learning abstract concepts from images in an unsupervised fashion lies in the required integration of visual perception and generalizable relational reasoning. Moreover, the unsupervised nature of this t…

Program SynthesisRelational Reasoning

Neural Structure Mapping For Learning Abstract Visual Analogies

2021-10-12 · NeurIPS Workshop SVRHM 2021 12 · Shashank Shekhar, Graham W. Taylor

Building conceptual abstractions from sensory information and then reasoning about them is central to human intelligence. Abstract reasoning both relies on, and is facilitated by, our ability to make analogies about conc…

Visual AnalogiesVisual Reasoning

DEVICE: DEpth and VIsual ConcEpts Aware Transformer for TextCaps

2023-02-03 · Dongsheng Xu, Qingbao Huang, Feng Shuang, Yi Cai

Text-based image captioning is an important but under-explored task, aiming to generate descriptions containing visual objects and scene text. Recent studies have made encouraging progress, but they are still suffering f…

Image CaptioningOptical Character Recognition (OCR)Relational Reasoning

Imagine, Reason and Write: Visual Storytelling with Graph Knowledge and Relational Reasoning

2021-05-18 · The Thirty-Fifth AAAI Conference on Artificial Intelligence 2021 5 · Chunpu Xu, Min Yang, Chengming Li, Ying Shen 외

Visual storytelling is a task of creating a short story based on photo streams. Different from visual captions, stories contain not only factual descriptions, but also imaginary concepts that do not appear in the images.…

DiversityInformativenessRelational ReasoningVisual Storytelling