paper-with-me

Papers

High-order Joint Constituency and Dependency Parsing

2023-09-21 · Yanggan Gu, Yang Hou, Zhefeng Wang, Xinyu Duan, Zhenghua Li

This work revisits the topic of jointly parsing constituency and dependency trees, i.e., to produce compatible constituency and dependency trees simultaneously for input sentences, which is attractive considering that the two types of trees are complementary in representing syntax. The original work of Zhou and Zhao (2019) performs joint parsing only at the inference phase. They train two separate parsers under the multi-task learning framework (i.e., one shared encoder and two independent decoders). They design an ad-hoc dynamic programming-based decoding algorithm of $O(n^5)$ time complexity for finding optimal compatible tree pairs. Compared to their work, we make progress in three aspects: (1) adopting a much more efficient decoding algorithm of $O(n^4)$ time complexity, (2) exploring joint modeling at the training phase, instead of only at the inference phase, (3) proposing high-order scoring components to promote constituent-dependency interaction. We conduct experiments and analysis on seven languages, covering both rich-resource and low-resource scenarios. Results and analysis show that joint modeling leads to a modest overall performance boost over separate modeling, but substantially improves the complete matching ratio of whole trees, thanks to the explicit modeling of tree compatibility.

📄 PDF Abstract BibTeX arXiv:2309.11888

Code (1)

egangu/high-order-joint-parsing 공식 구현 pytorch

Tasks

Dependency ParsingMulti-Task Learning

Similar Papers 제목 키워드 기반

StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling

2020-12-01 · ACL 2021 5 · Yikang Shen, Yi Tay, Che Zheng, Dara Bahri 외

There are two major classes of natural language grammar -- the dependency grammar that models one-to-one correspondences between words and the constituency grammar that models the assembly of one or several corresponded …

Constituency ParsingDependency ParsingLanguage ModelingLanguage Modelling+2

A Dependency Perspective on RST Discourse Parsing and Evaluation

2018-06-01 · CL 2018 6 · Mathieu Morey, Philippe Muller, Nicholas Asher

Computational text-level discourse analysis mostly happens within Rhetorical Structure Theory (RST), whose structures have classically been presented as constituency trees, and relies on data from the RST Discourse Treeb…

Constituency ParsingDependency ParsingDiscourse Parsing

Dependency Induction Through the Lens of Visual Perception

2021-09-20 · CoNLL (EMNLP) 2021 11 · Ruisi Su, Shruti Rijhwani, Hao Zhu, Junxian He 외

Most previous work on grammar induction focuses on learning phrasal or dependency structure purely from text. However, because the signal provided by text alone is limited, recently introduced visually grounded syntax mo…

Constituency Grammar InductionConstituency ParsingDependency Parsing

Joint Syntacto-Discourse Parsing and the Syntacto-Discourse Treebank

2017-08-28 · EMNLP 2017 9 · Kai Zhao, Liang Huang

Discourse parsing has long been treated as a stand-alone problem independent from constituency or dependency parsing. Most attempts at this problem are pipelined rather than end-to-end, sophisticated, and not self-contai…

Dependency ParsingDiscourse Parsing

Corpus-Based Induction of Syntactic Structure: Models of Dependency and Constituency

2004-07-01 · Dan Klein, Christopher Manning

We present a generative model for the unsupervised learning of dependency structures. We also describe the multiplicative combination of this dependency model with a model of linear constituency. The product model outper…

Constituency ParsingDependency ParsingUnsupervised Dependency Parsing