Learning to Extract Structured Entities Using Language Models
Recent advances in machine learning have significantly impacted the field of information extraction, with Language Models (LMs) playing a pivotal role in extracting structured information from unstructured text. Prior works typically represent information extraction as triplet-centric and use classical metrics such as precision and recall for evaluation. We reformulate the task to be entity-centric, enabling the use of diverse metrics that can provide more insights from various perspectives. We contribute to the field by introducing Structured Entity Extraction and proposing the Approximate Entity Set OverlaP (AESOP) metric, designed to appropriately assess model performance. Later, we introduce a new Multistage Structured Entity Extraction (MuSEE) model that harnesses the power of LMs for enhanced effectiveness and efficiency by decomposing the extraction task into multiple stages. Quantitative and human side-by-side evaluations confirm that our model outperforms baselines, offering promising directions for future advancements in structured entity extraction. Our source code and datasets are available at https://github.com/microsoft/Structured-Entity-Extraction.
Code (1)
Tasks
TripletMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Structured prediction models for RNN based sequence labeling in clinical text
Sequence labeling is a widely used method for named entity recognition and information extraction from unstructured natural language data. In clinical domain one major application of sequence labeling involves extraction…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Structured PredictionHarnessing Generative LLMs for Enhanced Financial Event Entity Extraction Performance
Financial event entity extraction is a crucial task for analyzing market dynamics and building financial knowledge graphs, yet it presents significant challenges due to the specialized language and complex structures in …
Knowledge Graphsparameter-efficient fine-tuningStructured Output GenerationLMDX: Language Model-based Document Information Extraction and Localization
Large Language Models (LLM) have revolutionized Natural Language Processing (NLP), improving state-of-the-art and exhibiting emergent capabilities across various tasks. However, their application in extracting informatio…
Language ModelingLanguage ModellingTNNT: The Named Entity Recognition Toolkit
Extraction of categorised named entities from text is a complex task given the availability of a variety of Named Entity Recognition (NER) models and the unstructured information encoded in different source document form…
graph constructionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1Fine-Grained Named Entities for Corona News
Information resources such as newspapers have produced unstructured text data in various languages related to the corona outbreak since December 2019. Analyzing these unstructured texts is time-consuming without represen…
Articlesnamed-entity-recognitionNamed Entity RecognitionRelation Extraction