paper-with-me

Papers

Compositional learning of functions in humans and machines

2024-03-18 · Yanli Zhou, Brenden M. Lake, Adina Williams

The ability to learn and compose functions is foundational to efficient learning and reasoning in humans, enabling flexible generalizations such as creating new dishes from known cooking processes. Beyond sequential chaining of functions, existing linguistics literature indicates that humans can grasp more complex compositions with interacting functions, where output production depends on context changes induced by different function orderings. Extending the investigation into the visual domain, we developed a function learning paradigm to explore the capacity of humans and neural network models in learning and reasoning with compositional functions under varied interaction conditions. Following brief training on individual functions, human participants were assessed on composing two learned functions, in ways covering four main interaction types, including instances in which the application of the first function creates or removes the context for applying the second function. Our findings indicate that humans can make zero-shot generalizations on novel visual function compositions across interaction conditions, demonstrating sensitivity to contextual changes. A comparison with a neural network model on the same task reveals that, through the meta-learning for compositionality (MLC) approach, a standard sequence-to-sequence Transformer can mimic human generalization patterns in composing functions.

📄 PDF Abstract BibTeX arXiv:2403.12201

Code (0)

등록된 구현이 없습니다.

Tasks

Meta-Learning

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Multi-Head Attention 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Ground-Compose-Reinforce: Grounding Language in Agentic Behaviours using Limited Data

2025-07-14 · Andrew C. Li, Toryn Q. Klassen, Andrew Wang, Parand A. Alamdari 외 arxiv

Grounding language in perception and action is a key challenge when building situated agents that can interact with humans, or other agents, via language. In the past, addressing this challenge has required manually desi…

Neural networks can understand compositional functions that humans do not, in the context of emergent communication

2021-03-06 · Hugh Perkins

We show that it is possible to craft transformations that, applied to compositional grammars, result in grammars that neural networks can learn easily, but humans do not. This could explain the disconnect between current…

Inductive BiasPosition

Emergence of Compositional Representations in Restricted Boltzmann Machines

2016-11-21 · Jérôme Tubiana, Rémi Monasson

Extracting automatically the complex set of features composing real high-dimensional data is crucial for achieving high performance in machine--learning tasks. Restricted Boltzmann Machines (RBM) are empirically known to…

Facilitating Multi-turn Function Calling for LLMs via Compositional Instruction Tuning

2024-10-16 · Mingyang Chen, Haoze Sun, Tianpeng Li, Fan Yang 외

Large Language Models (LLMs) have exhibited significant potential in performing diverse tasks, including the ability to call functions or use external tools to enhance their performance. While current research on functio…

8k

Human few-shot learning of compositional instructions

2019-01-14 · Brenden M. Lake, Tal Linzen, Marco Baroni

People learn in fast and flexible ways that have not been emulated by machines. Once a person learns a new verb "dax," he or she can effortlessly understand how to "dax twice," "walk and dax," or "dax vigorously." There …

Few-Shot Learning