Towards Semi-Supervised Learning for Deep Semantic Role Labeling
Neural models have shown several state-of-the-art performances on Semantic Role Labeling (SRL). However, the neural models require an immense amount of semantic-role corpora and are thus not well suited for low-resource languages or domains. The paper proposes a semi-supervised semantic role labeling method that outperforms the state-of-the-art in limited SRL training corpora. The method is based on explicitly enforcing syntactic constraints by augmenting the training objective with a syntactic-inconsistency loss component and uses SRL-unlabeled instances to train a joint-objective LSTM. On CoNLL-2012 English section, the proposed semi-supervised training with 1%, 10% SRL-labeled data and varying amounts of SRL-unlabeled data achieves +1.58, +0.78 F1, respectively, over the pre-trained models that were trained on SOTA architecture with ELMo on the same SRL-labeled data. Additionally, by using the syntactic-inconsistency loss on inference time, the proposed model achieves +3.67, +2.1 F1 over pre-trained model on 1%, 10% SRL-labeled data, respectively.
Code (0)
등록된 구현이 없습니다.
Tasks
Semantic Role LabelingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Semi-Supervised Semantic Role Labeling: Approaching from an Unsupervised Perspective
Semi-Supervised Semantic Role Labeling via Structural Alignment
Facing the most difficult case of Semantic Role Labeling: A collaboration of word embeddings and co-training
We present a successful collaboration of word embeddings and co-training to tackle in the most difficult test case of semantic role labeling: predicting out-of-domain and unseen semantic frames. Despite the fact that co-…
Semantic Role LabelingWord EmbeddingsSemi-Supervised Semantic Role Labeling with Cross-View Training
The successful application of neural networks to a variety of NLP tasks has provided strong impetus to develop end-to-end models for semantic role labeling which forego the need for extensive feature engineering. Recent …
Dependency ParsingFeature EngineeringPOSPOS Tagging+2Structured Consistency Loss for semi-supervised semantic segmentation
The consistency loss has played a key role in solving problems in recent studies on semi-supervised learning. Yet extant studies with the consistency loss are limited to its application to classification tasks; extant st…
General ClassificationSegmentationSemantic SegmentationSemi-Supervised Semantic Segmentation