paper-with-me

Papers

Predicate learning in neural systems: Discovering latent generative structures

2018-10-02 · Andrea E. Martin, Leonidas A. A. Doumas

Humans learn complex latent structures from their environments (e.g., natural language, mathematics, music, social hierarchies). In cognitive science and cognitive neuroscience, models that infer higher-order structures from sensory or first-order representations have been proposed to account for the complexity and flexibility of human behavior. But how do the structures that these models invoke arise in neural systems in the first place? To answer this question, we explain how a system can learn latent representational structures (i.e., predicates) from experience with wholly unstructured data. During the process of predicate learning, an artificial neural network exploits the naturally occurring dynamic properties of distributed computing across neuronal assemblies in order to learn predicates, but also to combine them compositionally, two computational aspects which appear to be necessary for human behavior as per formal theories in multiple domains. We describe how predicates can be combined generatively using neural oscillations to achieve human-like extrapolation and compositionality in an artificial neural network. The ability to learn predicates from experience, to represent structures compositionally, and to extrapolate to unseen data offers an inroads to understanding and modeling the most complex human behaviors.

📄 PDF Abstract BibTeX arXiv:1810.01127

Code (0)

등록된 구현이 없습니다.

Tasks

Distributed Computing

Similar Papers 제목 키워드 기반

Predicate Invention by Learning From Failures

2021-04-29 · Andrew Cropper, Rolf Morel

Discovering novel high-level concepts is one of the most important steps needed for human-level AI. In inductive logic programming (ILP), discovering novel high-level concepts is known as predicate invention (PI). Althou…

Inductive logic programming

Scalable Diffusion for Materials Generation

2023-10-18 · Sherry Yang, KwangHwan Cho, Amil Merchant, Pieter Abbeel 외

Generative models trained on internet-scale data are capable of generating novel and realistic texts, images, and videos. A natural next question is whether these models can advance science, for example by generating nov…

Formation Energy

Discovering Latent Network Topology in Contextualized Representations with Randomized Dynamic Programming

2021-09-29 · Yao Fu, Mirella Lapata

The discovery of large-scale discrete latent structures is crucial for understanding the fundamental generative processes of language. In this work, we use structured latent variables to study the representation space of…

Paraphrase Generation

Conversational Semantic Role Labeling with Predicate-Oriented Latent Graph

2022-10-06 · Hao Fei, Shengqiong Wu, Meishan Zhang, Yafeng Ren 외

Conversational semantic role labeling (CSRL) is a newly proposed task that uncovers the shallow semantic structures in a dialogue text. Unfortunately several important characteristics of the CSRL task have been overlooke…

Language ModelingLanguage ModellingSemantic Role Labeling

Discovering Textual Structures: Generative Grammar Induction using Template Trees

2020-09-09 · Thomas Winters, Luc De Raedt

Natural language generation provides designers with methods for automatically generating text, e.g. for creating summaries, chatbots and game content. In practise, text generators are often either learned and hard to int…

Text Generation