paper-with-me

홈 › Papers

Concepts, Properties and an Approach for Compositional Generalization

2021-02-08 · Yuanpeng Li

Compositional generalization is the capacity to recognize and imagine a large amount of novel combinations from known components. It is a key in human intelligence, but current neural networks generally lack such ability. This report connects a series of our work for compositional generalization, and summarizes an approach. The first part contains concepts and properties. The second part looks into a machine learning approach. The approach uses architecture design and regularization to regulate information of representations. This report focuses on basic ideas with intuitive and illustrative explanations. We hope this work would be helpful to clarify fundamentals of compositional generalization and lead to advance artificial intelligence.

📄 PDF Abstract BibTeX arXiv:2102.04225

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

From Red Wine to Red Tomato: Composition With Context

2017-07-01 · CVPR 2017 7 · Ishan Misra, Abhinav Gupta, Martial Hebert

Compositionality and contextuality are key building blocks of intelligence. They allow us to compose known concepts to generate new and complex ones. However, traditional learning methods do not model both these properti…

Combine to Describe: Evaluating Compositional Generalization in Image Captioning

2022-05-01 · ACL 2022 5 · George Pantazopoulos, Alessandro Suglia, Arash Eshghi

Compositionality – the ability to combine simpler concepts to understand & generate arbitrarily more complex conceptual structures – has long been thought to be the cornerstone of human language capacity. With the recent…

Image Captioning

Towards Compositionality in Concept Learning

2024-06-26 · Adam Stein, Aaditya Naik, Yinjun Wu, Mayur Naik 외

Concept-based interpretability methods offer a lens into the internals of foundation models by decomposing their embeddings into high-level concepts. These concept representations are most useful when they are compositio…

Flexible Compositional Learning of Structured Visual Concepts

2021-05-20 · Yanli Zhou, Brenden M. Lake

Humans are highly efficient learners, with the ability to grasp the meaning of a new concept from just a few examples. Unlike popular computer vision systems, humans can flexibly leverage the compositional structure of t…

Program induction

Interaction Asymmetry: A General Principle for Learning Composable Abstractions

2024-11-12 · Jack Brady, Julius von Kügelgen, Sébastien Lachapelle, Simon Buchholz 외

Learning disentangled representations of concepts and re-composing them in unseen ways is crucial for generalizing to out-of-domain situations. However, the underlying properties of concepts that enable such disentanglem…

Disentanglement