A Structured Span Selector
Many natural language processing tasks, e.g., coreference resolution and semantic role labeling, require selecting text spans and making decisions about them. A typical approach to such tasks is to score all possible spans and greedily select spans for task-specific downstream processing. This approach, however, does not incorporate any inductive bias about what sort of spans ought to be selected, e.g., that selected spans tend to be syntactic constituents. In this paper, we propose a novel grammar-based structured span selection model which learns to make use of the partial span-level annotation provided for such problems. Compared to previous approaches, our approach gets rid of the heuristic greedy span selection scheme, allowing us to model the downstream task on an optimal set of spans. We evaluate our model on two popular span prediction tasks: coreference resolution and semantic role labeling. We show empirical improvements on both.
Code (1)
Tasks
coreference-resolutionCoreference ResolutionInductive BiasSemantic Role LabelingSimilar Papers 제목 키워드 기반
Using Context to Improve the Spanish WordNet Translation
We present some strategies for improving the Spanish version of WordNet, part of the MCR, selecting new lemmas for the Spanish synsets by translating the lemmas of the corresponding English synsets. We used four simple s…
TranslationOn the Effectiveness of Minimal Context Selection for Robust Question Answering
Machine learning models for question-answering (QA), where given a question and a passage, the learner must select some span in the passage as an answer, are known to be brittle. By inserting a single nuisance sentence i…
Adversarial RobustnessQuestion AnsweringSentenceStructured Matrix Recovery via the Generalized Dantzig Selector
In recent years, structured matrix recovery problems have gained considerable attention for its real world applications, such as recommender systems and computer vision. Much of the existing work has focused on matrices …
Recommendation SystemsImproving Distantly Supervised Relation Extraction with Neural Noise Converter and Conditional Optimal Selector
Distant supervised relation extraction has been successfully applied to large corpus with thousands of relations. However, the inevitable wrong labeling problem by distant supervision will hurt the performance of relatio…
RelationRelation ExtractionDeep Elastic Networks with Model Selection for Multi-Task Learning
In this work, we consider the problem of instance-wise dynamic network model selection for multi-task learning. To this end, we propose an efficient approach to exploit a compact but accurate model in a backbone architec…
image-classificationImage ClassificationModel SelectionMulti-Task Learning