Type-supervised sequence labeling based on the heterogeneous star graph for named entity recognition
Named entity recognition is a fundamental task in natural language processing, identifying the span and category of entities in unstructured texts. The traditional sequence labeling methodology ignores the nested entities, i.e. entities included in other entity mentions. Many approaches attempt to address this scenario, most of which rely on complex structures or have high computation complexity. The representation learning of the heterogeneous star graph containing text nodes and type nodes is investigated in this paper. In addition, we revise the graph attention mechanism into a hybrid form to address its unreasonableness in specific topologies. The model performs the type-supervised sequence labeling after updating nodes in the graph. The annotation scheme is an extension of the single-layer sequence labeling and is able to cope with the vast majority of nested entities. Extensive experiments on public NER datasets reveal the effectiveness of our model in extracting both flat and nested entities. The method achieved state-of-the-art performance on both flat and nested datasets. The significant improvement in accuracy reflects the superiority of the multi-layer labeling strategy.
Code (1)
Tasks
Graph Attentionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERNested Named Entity RecognitionRepresentation LearningSimilar Papers 제목 키워드 기반
Decomposed Meta-Learning for Few-Shot Sequence Labeling
Few-shot sequence labeling is a general problem formulation for many natural language understanding tasks in data-scarcity scenarios, which require models to generalize to new types via only a few labeled examples. Recen…
Entity TypingEvent DetectionFew-shot NERMeta-Learning+8SOHET: Sequence Of Heterogeneous Events Transformer with Self-Supervised Pre-Training
Many machine learning applications rely on heterogeneous event streams to make predictions, either causally as events arrive or bidirectionally over complete sequences. We propose SOHET (Sequence Of Heterogeneous Events …
Fraud DetectionCross-Supervised Joint-Event-Extraction with Heterogeneous Information Networks
Joint-event-extraction, which extracts structural information (i.e., entities or triggers of events) from unstructured real-world corpora, has attracted more and more research attention in natural language processing. Mo…
Event ExtractionTAGP4E: Few-Shot Event Detection as Prompt-Guided Identification and Localization
We propose P4E, an identify-and-localize event detection framework that integrates the best of few-shot prompting and structured prediction. Our framework decomposes event detection into an identification task and a loca…
Event DetectionEvent ExtractionFew-Shot LearningMulti-Label Classification+2EEVEE: An Easy Annotation Tool for Natural Language Processing
Annotation tools are the starting point for creating Natural Language Processing (NLP) datasets. There is a wide variety of tools available; setting up these tools is however a hindrance. We propose EEVEE, an annotation …
text-classificationText Classification