paper-with-me

홈 › Papers

Concept Discovery for Fast Adapatation

2023-01-19 · Shengyu Feng, Hanghang Tong

The advances in deep learning have enabled machine learning methods to outperform human beings in various areas, but it remains a great challenge for a well-trained model to quickly adapt to a new task. One promising solution to realize this goal is through meta-learning, also known as learning to learn, which has achieved promising results in few-shot learning. However, current approaches are still enormously different from human beings' learning process, especially in the ability to extract structural and transferable knowledge. This drawback makes current meta-learning frameworks non-interpretable and hard to extend to more complex tasks. We tackle this problem by introducing concept discovery to the few-shot learning problem, where we achieve more effective adaptation by meta-learning the structure among the data features, leading to a composite representation of the data. Our proposed method Concept-Based Model-Agnostic Meta-Learning (COMAML) has been shown to achieve consistent improvements in the structured data for both synthesized datasets and real-world datasets.

📄 PDF Abstract BibTeX arXiv:2301.07850

Code (0)

등록된 구현이 없습니다.

Tasks

Few-Shot LearningMeta-Learning

Similar Papers 제목 키워드 기반

Existence of recombination-selection equilibria for sexual populations

2017-03-24

We study a birth and death model for the adapatation of a sexual population to an environment. The population is structured by a phenotypical trait, and, possibly, an age variable. Recombination is modeled by Fisher's in…

Applications and Techniques for Fast Machine Learning in Science

2021-10-25 · Allison McCarn Deiana, Nhan Tran, Joshua Agar, Michaela Blott 외

In this community review report, we discuss applications and techniques for fast machine learning (ML) in science -- the concept of integrating power ML methods into the real-time experimental data processing loop to acc…

BIG-bench Machine Learningscientific discovery

Can we automatize scientific discovery in the cognitive sciences?

2026-03-22 · Akshay K. Jagadish, Milena Rmus, Kristin Witte, Marvin Mathony 외 arxiv

The cognitive sciences aim to understand intelligence by formalizing underlying operations as computational models. Traditionally, this follows a cycle of discovery where researchers develop paradigms, collect data, and …

Program Synthesis

JEFL: Joint Embedding of Formal Proof Libraries

2021-07-21 · Qingxiang Wang, Cezary Kaliszyk

The heterogeneous nature of the logical foundations used in different interactive proof assistant libraries has rendered discovery of similar mathematical concepts among them difficult. In this paper, we compare a previo…

When are Post-hoc Conceptual Explanations Identifiable?

2022-06-28 · Tobias Leemann, Michael Kirchhof, Yao Rong, Enkelejda Kasneci 외

Interest in understanding and factorizing learned embedding spaces through conceptual explanations is steadily growing. When no human concept labels are available, concept discovery methods search trained embedding space…

Disentanglement