Position-aware Attention and Supervised Data Improve Slot Filling
Organized relational knowledge in the form of {``}knowledge graphs{''} is important for many applications. However, the ability to populate knowledge bases with facts automatically extracted from documents has improved frustratingly slowly. This paper simultaneously addresses two issues that have held back prior work. We first propose an effective new model, which combines an LSTM sequence model with a form of entity position-aware attention that is better suited to relation extraction. Then we build TACRED, a large (119,474 examples) supervised relation extraction dataset obtained via crowdsourcing and targeted towards TAC KBP relations. The combination of better supervised data and a more appropriate high-capacity model enables much better relation extraction performance. When the model trained on this new dataset replaces the previous relation extraction component of the best TAC KBP 2015 slot filling system, its F1 score increases markedly from 22.2{\%} to 26.7{\%}.
Code (2)
Tasks
FormKnowledge Base PopulationKnowledge GraphsPositionRelationRelation Extractionslot-fillingSlot FillingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Semantic Attention Flow Fields for Monocular Dynamic Scene Decomposition
From video, we reconstruct a neural volume that captures time-varying color, density, scene flow, semantics, and attention information. The semantics and attention let us identify salient foreground objects separately fr…
ClusteringCompositional Generalization for Neural Semantic Parsing via Span-level Supervised Attention
We describe a span-level supervised attention loss that improves compositional generalization in semantic parsers. Our approach builds on existing losses that encourage attention maps in neural sequence-to-sequence model…
Machine TranslationSemantic ParsingTranslationWord AlignmentUnsupervised Structural Scene Decomposition via Foreground-Aware Slot Attention with Pseudo-Mask Guidance
Recent advances in object-centric representation learning have shown that slot attention-based methods can effectively decompose visual scenes into object slot representations without supervision. However, existing appro…
Representation LearningSACT: Self-Aware Multi-Space Feature Composition Transformer for Multinomial Attention for Video Captioning
Video captioning works on the two fundamental concepts, feature detection and feature composition. While modern day transformers are beneficial in composing features, they lack the fundamental problems of selecting and u…
Dense Video CaptioningVideo CaptioningPiSLTRc: Position-informed Sign Language Transformer with Content-aware Convolution
Since the superiority of Transformer in learning long-term dependency, the sign language Transformer model achieves remarkable progress in Sign Language Recognition (SLR) and Translation (SLT). However, there are several…
DecoderPositionSign Language RecognitionTranslation