paper-with-me

홈 › Papers

MetaConcept: Learn to Abstract via Concept Graph for Weakly-Supervised Few-Shot Learning

2020-07-05 · Baoquan Zhang, Ka-Cheong Leung, Yunming Ye, Xutao Li

Meta-learning has been proved to be an effective framework to address few-shot learning problems. The key challenge is how to minimize the generalization error of base learner across tasks. In this paper, we explore the concept hierarchy knowledge by leveraging concept graph, and take the concept graph as explicit meta-knowledge for the base learner, instead of learning implicit meta-knowledge, so as to boost the classification performance of meta-learning on weakly-supervised few-shot learning problems. To this end, we propose a novel meta-learning framework, called MetaConcept, which learns to abstract concepts via the concept graph. Specifically, we firstly propose a novel regularization with multi-level conceptual abstraction to constrain a meta-learner to learn to abstract concepts via the concept graph (i.e. identifying the concepts from low to high levels). Then, we propose a meta concept inference network as the meta-learner for the base learner, aiming to quickly adapt to a novel task by the joint inference of the abstract concepts and a few annotated samples. We have conducted extensive experiments on two weakly-supervised few-shot learning benchmarks, namely, WS-ImageNet-Pure and WS-ImageNet-Mix. Our experimental results show that 1) the proposed MetaConcept outperforms state-of-the-art methods with an improvement of 2% to 6% in classification accuracy; 2) the proposed MetaConcept can be able to yield a good performance though merely training with weakly-labeled data sets.

📄 PDF Abstract BibTeX arXiv:2007.02379

Code (0)

등록된 구현이 없습니다.

Tasks

Few-Shot LearningMeta-Learning

Similar Papers 제목 키워드 기반

Visual Concept-Metaconcept Learning

2020-02-04 · NeurIPS 2019 12 · Chi Han, Jiayuan Mao, Chuang Gan, Joshua B. Tenenbaum 외

Humans reason with concepts and metaconcepts: we recognize red and green from visual input; we also understand that they describe the same property of objects (i.e., the color). In this paper, we propose the visual conce…

Metaconcepts of rooted tree balance

2025-06-10 · Mareike Fischer, Tom Niklas Hamann, Kristina Wicke

Measures of tree balance play an important role in many different research areas such as mathematical phylogenetics or theoretical computer science. Typically, tree balance is quantified by a single number which is assig…

Learning Concept Abstractness Using Weak Supervision

2018-09-05 · EMNLP 2018 10 · Ella Rabinovich, Benjamin Sznajder, Artem Spector, Ilya Shnayderman 외

We introduce a weakly supervised approach for inferring the property of abstractness of words and expressions in the complete absence of labeled data. Exploiting only minimal linguistic clues and the contextual usage of …

How Do Large Language Models Learn Concepts During Continual Pre-Training?

2026-01-07 · Barry Menglong Yao, Sha Li, Yunzhi Yao, Minqian Liu 외 arxiv

Human beings primarily understand the world through concepts (e.g., dog), abstract mental representations that structure perception, reasoning, and learning. However, how large language models (LLMs) acquire, retain, and…

Continual Pretraining

Weakly Supervised Annotations for Multi-modal Greeting Cards Dataset

2022-12-01 · Sidra Hanif, Longin Jan Latecki

In recent years, there is a growing number of pre-trained models trained on a large corpus of data and yielding good performance on various tasks such as classifying multimodal datasets. These models have shown good perf…

Image CaptioningImage GenerationText to Image GenerationText-to-Image Generation