Creating POS Tagging and Dependency Parsing Experts via Topic Modeling
Part of speech (POS) taggers and dependency parsers tend to work well on homogeneous datasets but their performance suffers on datasets containing data from different genres. In our current work, we investigate how to create POS tagging and dependency parsing experts for heterogeneous data by employing topic modeling. We create topic models (using Latent Dirichlet Allocation) to determine genres from a heterogeneous dataset and then train an expert for each of the genres. Our results show that the topic modeling experts reach substantial improvements when compared to the general versions. For dependency parsing, the improvement reaches 2 percent points over the full training baseline when we use two topics.
Code (0)
등록된 구현이 없습니다.
Tasks
Dependency ParsingDomain AdaptationPOSPOS TaggingTopic ModelsSimilar Papers 제목 키워드 기반
Similarity Based Genre Identification for POS Tagging Experts \& Dependency Parsing
POS tagging and dependency parsing achieve good results for homogeneous datasets. However, these tasks are much more difficult on heterogeneous datasets. In (Mukherjee et al. 2016, 2017), we address this issue by creatin…
Dependency ParsingDomain AdaptationPOSPOS Tagging+1Joint POS Tagging and Dependency Parsing with Transition-based Neural Networks
While part-of-speech (POS) tagging and dependency parsing are observed to be closely related, existing work on joint modeling with manually crafted feature templates suffers from the feature sparsity and incompleteness p…
Dependency ParsingPart-Of-Speech TaggingPOSPOS TaggingA Joint Model for Graph-based Chinese Dependency Parsing
In Chinese dependency parsing, the joint model of word segmentation, POS tagging and dependency parsing has become the mainstream framework because it can eliminate error propagation and share knowledge, where the transi…
Chinese Dependency ParsingChinese Word SegmentationDependency ParsingPOS+3A Novel Neural Network Model for Joint POS Tagging and Graph-based Dependency Parsing
We present a novel neural network model that learns POS tagging and graph-based dependency parsing jointly. Our model uses bidirectional LSTMs to learn feature representations shared for both POS tagging and dependency p…
Dependency ParsingFeature EngineeringPart-Of-Speech TaggingPOS+2Benchmarking zero-shot and few-shot approaches for tokenization, tagging, and dependency parsing of Tagalog text
The grammatical analysis of texts in any written language typically involves a number of basic processing tasks, such as tokenization, morphological tagging, and dependency parsing. State-of-the-art systems can achieve h…
BenchmarkingData AugmentationDependency ParsingMorphological Tagging+1