Improving Syntactic Parsing with Consistency Learning
In this paper, we propose using \emph{consistency learning} to improve constituency and dependency parsing performances on a multi-task setting. It utilizes a consistent constraint between the predictions. While multi-task learning implicitly learns shared representations for multiple sub-tasks, our method introduces an explicit consistency objective, which encourages shared representations that result in consistent predictions. Our intuition is that correct predictions are more likely consistent ones. To introduce consistent constraints, we propose a general method for introducing consistency objectives, as well as other prior knowledge, into existing neural models. This method only requires a boolean function that tells whether or not the multiple predictions are consistent, which does not need to be differentiable. We demonstrate the efficacy of our method by showing that it out-performs a state-of-the-art joint dependency and constituency parser on CTB.
Code (0)
등록된 구현이 없습니다.
Tasks
Dependency ParsingMulti-Task LearningSimilar Papers 제목 키워드 기반
Enhancing Korean Dependency Parsing with Morphosyntactic Features
This paper introduces UniDive for Korean, an integrated framework that bridges Universal Dependencies (UD) and Universal Morphology (UniMorph) to enhance the representation and processing of Korean {morphosyntax}. Korean…
DecoderDependency ParsingA Conditional Splitting Framework for Efficient Constituency Parsing
We introduce a generic seq2seq parsing framework that casts constituency parsing problems (syntactic and discourse parsing) into a series of conditional splitting decisions. Our parsing model estimates the conditional pr…
Constituency ParsingDiscourse ParsingDiscourse SegmentationSegmentationA Survey of Syntactic-Semantic Parsing Based on Constituent and Dependency Structures
Syntactic and semantic parsing has been investigated for decades, which is one primary topic in the natural language processing community. This article aims for a brief survey on this topic. The parsing community include…
Dependency ParsingSemantic ParsingAccurate Deep Syntactic Parsing of Graphs: The Case of French
Parsing predicate-argument structures in a deep syntax framework requires graphs to be predicted. Argument structures represent a higher level of abstraction than the syntactic ones and are thus more difficult to predict…
Syntactic Structure Processing in the Brain while Listening
Syntactic parsing is the task of assigning a syntactic structure to a sentence. There are two popular syntactic parsing methods: constituency and dependency parsing. Recent works have used syntactic embeddings based on c…
Activity PredictionDependency ParsingSentence