paper-with-me

Papers

Parsing as Tagging

2020-05-01 · LREC 2020 5 · Robert Vacareanu, George Caique Gouveia Barbosa, Marco A. Valenzuela-Esc{\'a}rcega, Mihai Surdeanu

We propose a simple yet accurate method for dependency parsing that treats parsing as tagging (PaT). That is, our approach addresses the parsing of dependency trees with a sequence model implemented with a bidirectional LSTM over BERT embeddings, where the {``}tag{''} to be predicted at each token position is the relative position of the corresponding head. For example, for the sentence John eats cake, the tag to be predicted for the token cake is -1 because its head (eats) occurs one token to the left. Despite its simplicity, our approach performs well. For example, our approach outperforms the state-of-the-art method of (Fern{\'a}ndez-Gonz{\'a}lez and G{\'o}mez-Rodr{\'\i}guez, 2019) on Universal Dependencies (UD) by 1.76{\%} unlabeled attachment score (UAS) for English, 1.98{\%} UAS for French, and 1.16{\%} UAS for German. On average, on 12 UD languages, our method with minimal tuning performs comparably with this state-of-the-art approach: better by 0.11{\%} UAS, and worse by 0.58{\%} LAS.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Dependency ParsingPositionSentenceTAG

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Weight Decay 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Adam 설명 없음
Multi-Head Attention 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Similar Papers 제목 키워드 기반

Joint POS Tagging and Dependency Parsing with Transition-based Neural Networks

2017-04-25 · Liner Yang, Meishan Zhang, Yang Liu, Nan Yu 외

While part-of-speech (POS) tagging and dependency parsing are observed to be closely related, existing work on joint modeling with manually crafted feature templates suffers from the feature sparsity and incompleteness p…

Dependency ParsingPart-Of-Speech TaggingPOSPOS Tagging

A Joint Model for Graph-based Chinese Dependency Parsing

2020-10-01 · CCL 2020 10 · Xingchen Li, Mingtong Liu, Yujie Zhang, Jinan Xu 외

In Chinese dependency parsing, the joint model of word segmentation, POS tagging and dependency parsing has become the mainstream framework because it can eliminate error propagation and share knowledge, where the transi…

Chinese Dependency ParsingChinese Word SegmentationDependency ParsingPOS+3

A Novel Neural Network Model for Joint POS Tagging and Graph-based Dependency Parsing

2017-05-16 · CONLL 2017 8 · Dat Quoc Nguyen, Mark Dras, Mark Johnson

We present a novel neural network model that learns POS tagging and graph-based dependency parsing jointly. Our model uses bidirectional LSTMs to learn feature representations shared for both POS tagging and dependency p…

Dependency ParsingFeature EngineeringPart-Of-Speech TaggingPOS+2

Is POS Tagging Necessary or Even Helpful for Neural Dependency Parsing?

2020-03-06 · Houquan Zhou, Yu Zhang, Zhenghua Li, Min Zhang

In the pre deep learning era, part-of-speech tags have been considered as indispensable ingredients for feature engineering in dependency parsing. But quite a few works focus on joint tagging and parsing models to avoid …

Dependency ParsingFeature EngineeringMulti-Task LearningPOS+2

Post-OCR parsing: building simple and robust parser via BIO tagging

2019-09-14 · NeurIPS Workshop Document_Intelligen 2019 12 · Wonseok Hwang, Seonghyeon Kim, Minjoon Seo, Jinyeong Yim 외

Parsing textual information embedded in images is important for various down- stream tasks. However, many previously developed parsers are limited to handling the information presented in one dimensional sequence format.…

Optical Character RecognitionOptical Character Recognition (OCR)