Deep Multitask Learning for Semantic Dependency Parsing
We present a deep neural architecture that parses sentences into three semantic dependency graph formalisms. By using efficient, nearly arc-factored inference and a bidirectional-LSTM composed with a multi-layer perceptron, our base system is able to significantly improve the state of the art for semantic dependency parsing, without using hand-engineered features or syntax. We then explore two multitask learning approaches---one that shares parameters across formalisms, and one that uses higher-order structures to predict the graphs jointly. We find that both approaches improve performance across formalisms on average, achieving a new state of the art. Our code is open-source and available at https://github.com/Noahs-ARK/NeurboParser.
Code (1)
Tasks
ARCDependency ParsingSemantic Dependency ParsingSimilar Papers 제목 키워드 기반
Hierarchical Multitask Learning with Dependency Parsing for Japanese Semantic Role Labeling Improves Performance of Argument Identification
With the advent of FrameNet and PropBank, many semantic role labeling (SRL) systems have been proposed in English. Although research on Japanese predicate argument structure analysis (PASA) has been conducted, most studi…
Dependency ParsingSemantic Role LabelingMultitask Learning for Cross-Lingual Transfer of Broad-coverage Semantic Dependencies
We describe a method for developing broad-coverage semantic dependency parsers for languages for which no semantically annotated resource is available. We leverage a multitask learning framework coupled with annotation p…
Cross-Lingual TransferMutlitask Learning for Cross-Lingual Transfer of Semantic Dependencies
We describe a method for developing broad-coverage semantic dependency parsers for languages for which no semantically annotated resource is available. We leverage a multitask learning framework coupled with an annotatio…
Cross-Lingual TransferMultiple Tasks Integration: Tagging, Syntactic and Semantic Parsing as a Single Task
Departing from both sequential pipelines and monotask systems, we propose Multiple Tasks Integration (MTI), a multitask paradigm orthogonal to weight sharing. The essence of MTI is to process the input iteratively but co…
Dependency ParsingPart-Of-Speech TaggingReinforcement Learning (RL)Semantic Dependency Parsing+1Multitask Easy-First Dependency Parsing: Exploiting Complementarities of Different Dependency Representations
In this paper we present a parsing model for projective dependency trees which takes advantage of the existence of complementary dependency annotations which is the case in Arabic, with the availability of CATiB and UD t…
ARCDependency Parsing