paper-with-me

Papers

Few-shot Visual Reasoning with Meta-analogical Contrastive Learning

2020-07-23 · NeurIPS 2020 12 · Youngsung Kim, Jinwoo Shin, Eunho Yang, Sung Ju Hwang

While humans can solve a visual puzzle that requires logical reasoning by observing only few samples, it would require training over large amount of data for state-of-the-art deep reasoning models to obtain similar performance on the same task. In this work, we propose to solve such a few-shot (or low-shot) visual reasoning problem, by resorting to analogical reasoning, which is a unique human ability to identify structural or relational similarity between two sets. Specifically, given training and test sets that contain the same type of visual reasoning problems, we extract the structural relationships between elements in both domains, and enforce them to be as similar as possible with analogical learning. We repeatedly apply this process with slightly modified queries of the same problem under the assumption that it does not affect the relationship between a training and a test sample. This allows to learn the relational similarity between the two samples in an effective manner even with a single pair of samples. We validate our method on RAVEN dataset, on which it outperforms state-of-the-art method, with larger gains when the training data is scarce. We further meta-learn our analogical contrastive learning model over the same tasks with diverse attributes, and show that it generalizes to the same visual reasoning problem with unseen attributes.

📄 PDF Abstract BibTeX arXiv:2007.12020

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningLogical ReasoningVisual Reasoning

Similar Papers 제목 키워드 기반

Analogy-Forming Transformers for Few-Shot 3D Parsing

2023-04-27 · Nikolaos Gkanatsios, Mayank Singh, Zhaoyuan Fang, Shubham Tulsiani 외

We present Analogical Networks, a model that encodes domain knowledge explicitly, in a collection of structured labelled 3D scenes, in addition to implicitly, as model parameters, and segments 3D object scenes with analo…

Few-Shot LearningMeta-Learning

Zero-shot visual reasoning through probabilistic analogical mapping

2022-09-29 · Taylor W. Webb, Shuhao Fu, Trevor Bihl, Keith J. Holyoak 외

Human reasoning is grounded in an ability to identify highly abstract commonalities governing superficially dissimilar visual inputs. Recent efforts to develop algorithms with this capacity have largely focused on approa…

Visual Reasoning

Enhancing multimodal analogical reasoning with Logic Augmented Generation

2025-04-15 · Anna Sofia Lippolis, Andrea Giovanni Nuzzolese, Aldo Gangemi

Recent advances in Large Language Models have demonstrated their capabilities across a variety of tasks. However, automatically extracting implicit knowledge from natural language remains a significant challenge, as mach…

Knowledge GraphsText Generation

Vision-and-Language Navigation with Analogical Textual Descriptions in LLMs

2025-09-29 · Yue Zhang, Tianyi Ma, Zun Wang, Yanyuan Qiao 외 arxiv

Integrating large language models (LLMs) into embodied AI models is becoming increasingly prevalent. However, existing zero-shot LLM-based Vision-and-Language Navigation (VLN) agents either encode images as textual scene…

Scene UnderstandingSpatial Reasoning

Elucidating STEM Concepts through Generative AI: A Multi-modal Exploration of Analogical Reasoning

2023-08-21 · Chen Cao, Zijian Ding, Gyeong-Geon Lee, Jiajun Jiao 외

This study explores the integration of generative artificial intelligence (AI), specifically large language models, with multi-modal analogical reasoning as an innovative approach to enhance science, technology, engineer…