paper-with-me

Papers

Neural Combinatory Constituency Parsing

2021-06-12 · Findings (ACL) 2021 8 · Zhousi Chen, Longtu Zhang, Aizhan Imankulova, Mamoru Komachi

We propose two fast neural combinatory models for constituency parsing: binary and multi-branching. Our models decompose the bottom-up parsing process into 1) classification of tags, labels, and binary orientations or chunks and 2) vector composition based on the computed orientations or chunks. These models have theoretical sub-quadratic complexity and empirical linear complexity. The binary model achieves an F1 score of 92.54 on Penn Treebank, speeding at 1327.2 sents/sec. Both the models with XLNet provide near state-of-the-art accuracies for English. Syntactic branching tendency and headedness of a language are observed during the training and inference processes for Penn Treebank, Chinese Treebank, and Keyaki Treebank (Japanese).

📄 PDF Abstract BibTeX arXiv:2106.06689

Code (1)

tmu-nlp/nccp 공식 구현 pytorch

Tasks

Constituency ParsingSENTS

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Challenges to Open-Domain Constituency Parsing

2022-05-01 · Findings (ACL) 2022 5 · Sen yang, Leyang Cui, Ruoxi Ning, Di wu 외

Neural constituency parsers have reached practical performance on news-domain benchmarks. However, their generalization ability to other domains remains weak. Existing findings on cross-domain constituency parsing are on…

Constituency Parsing

Joint Chinese Word Segmentation and Span-based Constituency Parsing

2022-11-03 · Zhicheng Wang, Tianyu Shi, Cong Liu

In constituency parsing, span-based decoding is an important direction. However, for Chinese sentences, because of their linguistic characteristics, it is necessary to utilize other models to perform word segmentation fi…

Chinese Word SegmentationConstituency ParsingSegmentation

LLM-enhanced Self-training for Cross-domain Constituency Parsing

2023-11-05 · Jianling Li, Meishan Zhang, Peiming Guo, Min Zhang 외

Self-training has proven to be an effective approach for cross-domain tasks, and in this study, we explore its application to cross-domain constituency parsing. Traditional self-training methods rely on limited and poten…

Constituency ParsingLanguage ModelingLanguage ModellingLarge Language Model

Semantic Parsing with Combinatory Categorial Grammars

2013-08-01 · ACL 2013 8 · Yoav Artzi, Nicholas FitzGerald, Luke Zettlemoyer
Decision MakingDecision Making Under UncertaintySemantic Parsing

Constituency Parsing using LLMs

2023-10-30 · Xuefeng Bai, Jialong Wu, Yulong Chen, Zhongqing Wang 외

Constituency parsing is a fundamental yet unsolved natural language processing task. In this paper, we explore the potential of recent large language models (LLMs) that have exhibited remarkable performance across variou…

Constituency Parsing