paper-with-me

Papers

Diversity-Aware Batch Active Learning for Dependency Parsing

2021-04-28 · NAACL 2021 4 · Tianze Shi, Adrian Benton, Igor Malioutov, Ozan İrsoy

While the predictive performance of modern statistical dependency parsers relies heavily on the availability of expensive expert-annotated treebank data, not all annotations contribute equally to the training of the parsers. In this paper, we attempt to reduce the number of labeled examples needed to train a strong dependency parser using batch active learning (AL). In particular, we investigate whether enforcing diversity in the sampled batches, using determinantal point processes (DPPs), can improve over their diversity-agnostic counterparts. Simulation experiments on an English newswire corpus show that selecting diverse batches with DPPs is superior to strong selection strategies that do not enforce batch diversity, especially during the initial stages of the learning process. Additionally, our diversityaware strategy is robust under a corpus duplication setting, where diversity-agnostic sampling strategies exhibit significant degradation.

📄 PDF Abstract BibTeX arXiv:2104.13936

Code (1)

tzshi/dpp-al-parsing-naacl21 공식 구현 pytorch

Tasks

Active LearningDependency ParsingDiversityPoint Processes

Similar Papers 제목 키워드 기반

A Distance-Aware Multi-Task Framework for Conversational Discourse Parsing

2022-10-01 · COLING 2022 10 · Yaxin Fan, Peifeng Li, Fang Kong, Qiaoming Zhu

Conversational discourse parsing aims to construct an implicit utterance dependency tree to reflect the turn-taking in a multi-party conversation. Existing works are generally divided into two lines: graph-based and tran…

Discourse ParsingMulti-Task Learning

Enforcing Structural Diversity in Cube-pruned Dependency Parsing

2014-06-01 · ACL 2014 6 · Hao Zhang, Ryan Mcdonald
Dependency ParsingDiversityPrepositional Phrase Attachment

Deep Active Learning for Sequence Labeling Based on Diversity and Uncertainty in Gradient

2020-11-27 · AACL (lifelongnlp) 2020 12 · Yekyung Kim

Recently, several studies have investigated active learning (AL) for natural language processing tasks to alleviate data dependency. However, for query selection, most of these studies mainly rely on uncertainty-based sa…

Active LearningDiversity

Data-driven, PCFG-based and Pseudo-PCFG-based Models for Chinese Dependency Parsing

2013-01-01 · TACL 2013 1 · Weiwei Sun, Xiaojun Wan

We present a comparative study of transition-, graph- and PCFG-based models aimed at illuminating more precisely the likely contribution of CFGs in improving Chinese dependency parsing accuracy, especially by combining h…

Chinese Dependency ParsingDependency ParsingDiversityPOS+1

Error Diversity Matters: An Error-Resistant Ensemble Method for Unsupervised Dependency Parsing

2024-12-16 · Behzad Shayegh, Hobie H. -B. Lee, Xiaodan Zhu, Jackie Chi Kit Cheung 외

We address unsupervised dependency parsing by building an ensemble of diverse existing models through post hoc aggregation of their output dependency parse structures. We observe that these ensembles often suffer from lo…

Dependency ParsingDiversityUnsupervised Dependency Parsing