paper-with-me

Papers

Abstracting Concept-Changing Rules for Solving Raven's Progressive Matrix Problems

2023-07-15 · Fan Shi, Bin Li, xiangyang xue

The abstract visual reasoning ability in human intelligence benefits discovering underlying rules in the novel environment. Raven's Progressive Matrix (RPM) is a classic test to realize such ability in machine intelligence by selecting from candidates. Recent studies suggest that solving RPM in an answer-generation way boosts a more in-depth understanding of rules. However, existing generative solvers cannot discover the global concept-changing rules without auxiliary supervision (e.g., rule annotations and distractors in candidate sets). To this end, we propose a deep latent variable model for Concept-changing Rule ABstraction (CRAB) by learning interpretable concepts and parsing concept-changing rules in the latent space. With the iterative learning process, CRAB can automatically abstract global rules shared on the dataset on each concept and form the learnable prior knowledge of global rules. CRAB outperforms the baselines trained without auxiliary supervision in the arbitrary-position answer generation task and achieves comparable and even higher accuracy than the compared models trained with auxiliary supervision. Finally, we conduct experiments to illustrate the interpretability of CRAB in concept learning, answer selection, and global rule abstraction.

📄 PDF Abstract BibTeX arXiv:2307.07734

Code (1)

fudanvi/generative-abstract-reasoning 공식 구현 pytorch

Tasks

Answer GenerationAnswer SelectionVisual Reasoning

Similar Papers 제목 키워드 기반

Raven's Progressive Matrices Completion with Latent Gaussian Process Priors

2021-03-22 · Fan Shi, Bin Li, xiangyang xue

Abstract reasoning ability is fundamental to human intelligence. It enables humans to uncover relations among abstract concepts and further deduce implicit rules from the relations. As a well-known abstract visual reason…

Answer SelectionGaussian ProcessesVisual Reasoning

Towards Generative Abstract Reasoning: Completing Raven's Progressive Matrix via Rule Abstraction and Selection

2024-01-18 · Fan Shi, Bin Li, xiangyang xue

Endowing machines with abstract reasoning ability has been a long-term research topic in artificial intelligence. Raven's Progressive Matrix (RPM) is widely used to probe abstract visual reasoning in machine intelligence…

Answer GenerationAttributeOdd One OutVisual Reasoning

Towards Learning to Reason: Comparing LLMs with Neuro-Symbolic on Arithmetic Relations in Abstract Reasoning

2024-12-07 · Michael Hersche, Giacomo Camposampiero, Roger Wattenhofer, Abu Sebastian 외

This work compares large language models (LLMs) and neuro-symbolic approaches in solving Raven's progressive matrices (RPM), a visual abstract reasoning test that involves the understanding of mathematical rules such as …

Attribute

A Cognitively-Inspired Neural Architecture for Visual Abstract Reasoning Using Contrastive Perceptual and Conceptual Processing

2023-09-19 · Yuan Yang, Deepayan Sanyal, James Ainooson, Joel Michelson 외

We introduce a new neural architecture for solving visual abstract reasoning tasks inspired by human cognition, specifically by observations that human abstract reasoning often interleaves perceptual and conceptual proce…

Inductive Bias

A Closer Look at Generalisation in RAVEN

2020-08-01 · ECCV 2020 8 · Steven Spratley, Krista Ehinger, Tim Miller

Humans have a remarkable capacity to draw parallels between concepts, generalising their experience to new domains. This skill is essential to solving the visual problems featured in the RAVEN and PGM datasets, yet, prev…

Visual Reasoning