A Bayesian Model for Generative Transition-based Dependency Parsing
We propose a simple, scalable, fully generative model for transition-based dependency parsing with high accuracy. The model, parameterized by Hierarchical Pitman-Yor Processes, overcomes the limitations of previous generative models by allowing fast and accurate inference. We propose an efficient decoding algorithm based on particle filtering that can adapt the beam size to the uncertainty in the model while jointly predicting POS tags and parse trees. The UAS of the parser is on par with that of a greedy discriminative baseline. As a language model, it obtains better perplexity than a n-gram model by performing semi-supervised learning over a large unlabelled corpus. We show that the model is able to generate locally and syntactically coherent sentences, opening the door to further applications in language generation.
Code (0)
등록된 구현이 없습니다.
Tasks
Dependency ParsingLanguage ModelingLanguage ModellingPOSText GenerationTransition-Based Dependency ParsingSimilar Papers 제목 키워드 기반
Bidirectional Transition-Based Dependency Parsing
Transition-based dependency parsing is a fast and effective approach for dependency parsing. Traditionally, a transitionbased dependency parser processes an input sentence and predicts a sequence of parsing actions in a …
Dependency ParsingSentenceTransition-Based Dependency ParsingVietnamese transition-based dependency parsing with supertag features
In recent years, dependency parsing is a fascinating research topic and has a lot of applications in natural language processing. In this paper, we present an effective approach to improve dependency parsing by utilizing…
Dependency ParsingTransition-Based Dependency ParsingGlobal Transition-based Non-projective Dependency Parsing
Shi, Huang, and Lee (2017) obtained state-of-the-art results for English and Chinese dependency parsing by combining dynamic-programming implementations of transition-based dependency parsers with a minimal set of bidire…
Chinese Dependency ParsingDependency ParsingTransition-Based Dependency Parsing using Perceptron Learner
Syntactic parsing using dependency structures has become a standard technique in natural language processing with many different parsing models, in particular data-driven models that can be trained on syntactically annot…
ARCDependency ParsingTransition-Based Dependency ParsingGraph-to-Graph Transformer for Transition-based Dependency Parsing
We propose the Graph2Graph Transformer architecture for conditioning on and predicting arbitrary graphs, and apply it to the challenging task of transition-based dependency parsing. After proposing two novel Transformer …
Dependency ParsingStructured PredictionTransition-Based Dependency Parsing