Sequence Alignment Ensemble with a Single Neural Network for Sequence Labeling
Sequence labeling, in which a class or label is assigned to each token in a given input order, is a fundamental task in natural language processing. Many advanced neural network architectures have recently been proposed to solve the sequential labeling problem affecting this task. By contrast, only a few approaches have been proposed to address the sequential ensemble problem. In this paper, we resolve the sequential ensemble problem by applying the sequential alignment method in a proposed ensemble framework. Specifically, we propose a simple but efficient ensemble candidate generation framework with which multiple heterogeneous systems can easily be prepared from a single neural sequence labeling network. To evaluate the proposed framework, experiments were conducted with part-of-speech (POS) tagging and dependency label prediction problems. The results indicate that the proposed framework achieved accuracy values that were higher by 0.19 and 0.33 than those achieved by the hard-voting method on the Penn-treebank POS-tagged and Universal dependency-tagged datasets, respectively.
Code (0)
등록된 구현이 없습니다.
Tasks
Part-Of-Speech TaggingPOSPOS TaggingSimilar Papers 제목 키워드 기반
Alignment based Sequence Ensemble with Multiple Results from a Single Neural Model Architecture
Sequence labeling is a fundamental framework that provides the elemental structure and content information for additional natural language processing. However, existing proposed ensemble approaches do not focus on sequen…
POSSequential Alignment Methods for Ensemble Part-of-Speech Tagging
Part-of-speech tagging is a fundamental task that provides the elemental structure and content information for additional natural language processing. Although Part-of-speech tagging problems have traditionally been form…
Part-Of-Speech TaggingSingle Model Ensemble using Pseudo-Tags and Distinct Vectors
Model ensemble techniques often increase task performance in neural networks; however, they require increased time, memory, and management effort. In this study, we propose a novel method that replicates the effects of a…
Managementtext-classificationText ClassificationBinaryAlign: Word Alignment as Binary Sequence Labeling
Real world deployments of word alignment are almost certain to cover both high and low resource languages. However, the state-of-the-art for this task recommends a different model class depending on the availability of g…
Word AlignmentMulti-head Sequence Tagging Model for Grammatical Error Correction
To solve the Grammatical Error Correction (GEC) problem , a mapping between a source sequence and a target one is needed, where the two differ only on few spans. For this reason, the attention has been shifted to the non…
DenoisingGrammatical Error CorrectionMulti-Task Learning