Multitask Easy-First Dependency Parsing: Exploiting Complementarities of Different Dependency Representations
In this paper we present a parsing model for projective dependency trees which takes advantage of the existence of complementary dependency annotations which is the case in Arabic, with the availability of CATiB and UD treebanks. Our system performs syntactic parsing according to both annotation types jointly as a sequence of arc-creating operations, and partially created trees for one annotation are also available to the other as features for the score function. This method gives error reduction of 9.9{\%} on CATiB and 6.1{\%} on UD compared to a strong baseline, and ablation tests show that the main contribution of this reduction is given by sharing tree representation between tasks, and not simply sharing BiLSTM layers as is often performed in NLP multitask systems.
Code (0)
등록된 구현이 없습니다.
Tasks
ARCDependency ParsingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Multiple Tasks Integration: Tagging, Syntactic and Semantic Parsing as a Single Task
Departing from both sequential pipelines and monotask systems, we propose Multiple Tasks Integration (MTI), a multitask paradigm orthogonal to weight sharing. The essence of MTI is to process the input iteratively but co…
Dependency ParsingPart-Of-Speech TaggingReinforcement Learning (RL)Semantic Dependency Parsing+1LSTM Easy-first Dependency Parsing with Pre-trained Word Embeddings and Character-level Word Embeddings in Vietnamese
In Vietnamese dependency parsing, several methods have been proposed. Dependency parser which uses deep neural network model has been reported that achieved state-of-the-art results. In this paper, we proposed a new meth…
Dependency ParsingWord EmbeddingsEffective Representation for Easy-First Dependency Parsing
Easy-first parsing relies on subtree re-ranking to build the complete parse tree. Whereas the intermediate state of parsing processing is represented by various subtrees, whose internal structural information is the key …
Dependency ParsingLanguage ModelingLanguage ModellingRe-RankingCross-lingual Transfer Learning and Multitask Learning for Capturing Multiword Expressions
Recent developments in deep learning have prompted a surge of interest in the application of multitask and transfer learning to NLP problems. In this study, we explore for the first time, the application of transfer lear…
Cross-Lingual TransferDependency ParsingTransfer LearningSequence Labeling Parsing by Learning Across Representations
We use parsing as sequence labeling as a common framework to learn across constituency and dependency syntactic abstractions. To do so, we cast the problem as multitask learning (MTL). First, we show that adding a parsin…
Constituency ParsingDependency Parsing