paper-with-me

홈 › Papers

Modelling Compositionality and Structure Dependence in Natural Language

2020-11-22 · Karthikeya Ramesh Kaushik, Andrea E. Martin

Human beings possess the most sophisticated computational machinery in the known universe. We can understand language of rich descriptive power, and communicate in the same environment with astonishing clarity. Two of the many contributors to the interest in natural language - the properties of Compositionality and Structure Dependence, are well documented, and offer a vast space to ask interesting modelling questions. The first step to begin answering these questions is to ground verbal theory in formal terms. Drawing on linguistics and set theory, a formalisation of these ideas is presented in the first half of this thesis. We see how cognitive systems that process language need to have certain functional constraints, viz. time based, incremental operations that rely on a structurally defined domain. The observations that result from analysing this formal setup are examined as part of a modelling exercise. Using the advances of word embedding techniques, a model of relational learning is simulated with a custom dataset to demonstrate how a time based role-filler binding mechanism satisfies some of the constraints described in the first section. The model's ability to map structure, along with its symbolic-connectionist architecture makes for a cognitively plausible implementation. The formalisation and simulation are together an attempt to recognise the constraints imposed by linguistic theory, and explore the opportunities presented by a cognitive model of relation learning to realise these constraints.

📄 PDF Abstract BibTeX arXiv:2012.02038

Code (0)

등록된 구현이 없습니다.

Tasks

DescriptiveRelational Reasoning

Similar Papers 제목 키워드 기반

Is Structure Dependence Shaped for Efficient Communication?: A Case Study on Coordination

2024-10-14 · Kohei Kajikawa, Yusuke Kubota, Yohei Oseki

Natural language exhibits various universal properties. But why do these universals exist? One explanation is that they arise from functional pressures to achieve efficient communication, a view which attributes cross-li…

counterfactual

Neural Tree Indexers for Text Understanding

2016-07-15 · EACL 2017 4 · Tsendsuren Munkhdalai, Hong Yu

Recurrent neural networks (RNNs) process input text sequentially and model the conditional transition between word tokens. In contrast, the advantages of recursive networks include that they explicitly model the composit…

Natural Language InferenceSentenceSentence Classification

Measuring non-trivial compositionality in emergent communication

2020-10-28 · Tomasz Korbak, Julian Zubek, Joanna Rączaszek-Leonardi

Compositionality is an important explanatory target in emergent communication and language evolution. The vast majority of computational models of communication account for the emergence of only a very basic form of comp…

Effect of Pressure for Compositionality on Language Emergence

2021-09-29 · Mihira Kasun Vithanage, Rukshan Darshana Wijesinghe, Alex Xavier, Dumindu Tissera 외

Humans can use natural languages compositionally, where complicated concepts are expressed using expressions grounded in simpler concepts. Hence, it has been argued that compositionality increases the ability of generali…

Categorial Grammar Induction as a Compositionality Measure for Understanding the Structure of Emergent Languages

2021-11-16 · ACL ARR November 2021 11 · Anonymous

This paper proposes a method for investigating the syntactic structure of emergent languages using categorial grammar induction. Although the structural property of emergent languages is an important topic, little has be…

Sentence