paper-with-me

홈 › Papers

Left-corner Methods for Syntactic Modeling with Universal Structural Constraints

2016-08-01 · Hiroshi Noji

The primary goal in this thesis is to identify better syntactic constraint or bias, that is language independent but also efficiently exploitable during sentence processing. We focus on a particular syntactic construction called center-embedding, which is well studied in psycholinguistics and noted to cause particular difficulty for comprehension. Since people use language as a tool for communication, one expects such complex constructions to be avoided for communication efficiency. From a computational perspective, center-embedding is closely relevant to a left-corner parsing algorithm, which can capture the degree of center-embedding of a parse tree being constructed. This connection suggests left-corner methods can be a tool to exploit the universal syntactic constraint that people avoid generating center-embedded structures. We explore such utilities of center-embedding as well as left-corner methods extensively through several theoretical and empirical examinations. Our primary task is unsupervised grammar induction. In this task, the input to the algorithm is a collection of sentences, from which the model tries to extract the salient patterns on them as a grammar. This is a particularly hard problem although we expect the universal constraint may help in improving the performance since it can effectively restrict the possible search space for the model. We build the model by extending the left-corner parsing algorithm for efficiently tabulating the search space except those involving center-embedding up to a specific degree. We examine the effectiveness of our approach on many treebanks, and demonstrate that often our constraint leads to better parsing performance. We thus conclude that left-corner methods are particularly useful for syntax-oriented systems, as it can exploit efficiently the inherent universal constraints in languages.

📄 PDF Abstract BibTeX arXiv:1608.00293

Code (0)

등록된 구현이 없습니다.

Tasks

Sentence

Similar Papers 제목 키워드 기반

Using Left-corner Parsing to Encode Universal Structural Constraints in Grammar Induction

2016-11-01 · EMNLP 2016 11 · Hiroshi Noji, Yusuke Miyao, Mark Johnson

Modeling Human Sentence Processing with Left-Corner Recurrent Neural Network Grammars

2021-09-10 · EMNLP 2021 11 · Ryo Yoshida, Hiroshi Noji, Yohei Oseki

In computational linguistics, it has been shown that hierarchical structures make language models (LMs) more human-like. However, the previous literature has been agnostic about a parsing strategy of the hierarchical mod…

Sentence

LSTMs Can Learn Syntax-Sensitive Dependencies Well, But Modeling Structure Makes Them Better

2018-07-01 · ACL 2018 7 · Adhiguna Kuncoro, Chris Dyer, John Hale, Dani Yogatama 외

Language exhibits hierarchical structure, but recent work using a subject-verb agreement diagnostic argued that state-of-the-art language models, LSTMs, fail to learn long-range syntax sensitive dependencies. Using the s…

DiagnosticLanguage ModelingLanguage ModellingMachine Translation+1

A Sound and Complete Left-Corner Parsing for Minimalist Grammars

2018-07-01 · WS 2018 7 · Milo{\v{s}} Stanojevi{\'c}, Edward Stabler

This paper presents a left-corner parser for minimalist grammars. The relation between the parser and the grammar is transparent in the sense that there is a very simple 1-1 correspondence between derivations and parses.…

Relation

Vector symbolic architectures for context-free grammars

2020-03-11 · Peter beim Graben, Markus Huber, Werner Meyer, Ronald Römer 외

Background / introduction. Vector symbolic architectures (VSA) are a viable approach for the hyperdimensional representation of symbolic data, such as documents, syntactic structures, or semantic frames. Methods. We pres…

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)