A Generative Parser with a Discriminative Recognition Algorithm
Generative models defining joint distributions over parse trees and sentences are useful for parsing and language modeling, but impose restrictions on the scope of features and are often outperformed by discriminative models. We propose a framework for parsing and language modeling which marries a generative model with a discriminative recognition model in an encoder-decoder setting. We provide interpretations of the framework based on expectation maximization and variational inference, and show that it enables parsing and language modeling within a single implementation. On the English Penn Treen-bank, our framework obtains competitive performance on constituency parsing while matching the state-of-the-art single-model language modeling score.
Code (0)
등록된 구현이 없습니다.
Tasks
Constituency ParsingDecoderLanguage ModelingLanguage ModellingVariational InferenceSimilar Papers 제목 키워드 기반
Unsupervised Cross-Lingual Adaptation of Dependency Parsers Using CRF Autoencoders
We consider the task of cross-lingual adaptation of dependency parsers without annotated target corpora and parallel corpora. Previous work either directly applies a discriminative source parser to the target language, i…
Combining Generative and Discriminative Approaches to Unsupervised Dependency Parsing via Dual Decomposition
Unsupervised dependency parsing aims to learn a dependency parser from unannotated sentences. Existing work focuses on either learning generative models using the expectation-maximization algorithm and its variants, or l…
ClusteringDependency Grammar InductionUnsupervised Dependency ParsingNeural Generative Rhetorical Structure Parsing
Rhetorical structure trees have been shown to be useful for several document-level tasks including summarization and document classification. Previous approaches to RST parsing have used discriminative models; however, t…
Document ClassificationTranslating Questions to SQL Queries with Generative Parsers Discriminatively Reranked
Enhancing Unsupervised Generative Dependency Parser with Contextual Information
Most of the unsupervised dependency parsers are based on probabilistic generative models that learn the joint distribution of the given sentence and its parse. Probabilistic generative models usually explicit decompose t…
Constituency Grammar InductionDependency Grammar InductionSentenceUnsupervised Dependency Parsing