Emergent Symbols through Binding in External Memory
In this blog post, we describe the paper 'Emergent Symbols through Binding in External Memory', which introduces the Emergent Symbol Binding Network (ESBN), a recurrent neural network with factorized augmented memory to solve several logical reasoning tasks. We describe the motivation and design choices of the ESBN in great detail, compare it to strong baselines, and perform a qualitative validation of the generalization claims from the original paper.
Code (0)
등록된 구현이 없습니다.
Tasks
Logical ReasoningSimilar Papers 제목 키워드 기반
Emergent Symbols through Binding in External Memory
A key aspect of human intelligence is the ability to infer abstract rules directly from high-dimensional sensory data, and to do so given only a limited amount of training experience. Deep neural network algorithms have …
A Memory-Augmented Neural Network Model of Abstract Rule Learning
Human intelligence is characterized by a remarkable ability to infer abstract rules from experience and apply these rules to novel domains. As such, designing neural network algorithms with this capacity is an important …
Emergent Communication between Heterogeneous Visual Agents through Decentralized Learning
Symbols are shared, but perception is private. We study emergent communication between heterogeneous visual agents through decentralized learning, asking what visual information can become shareable when agents have diff…
Text RetrievalMemory Matching Networks for Genomic Sequence Classification
When analyzing the genome, researchers have discovered that proteins bind to DNA based on certain patterns of the DNA sequence known as "motifs". However, it is difficult to manually construct motifs due to their complex…
ClassificationGeneral ClassificationLearning Distributed Representations of Symbolic Structure Using Binding and Unbinding Operations
Widely used recurrent units, including Long-short Term Memory (LSTM) and Gated Recurrent Unit (GRU), perform well on natural language tasks, but their ability to learn structured representations is still questionable. Ex…
Natural Language Inference