ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPT
Zero-shot information extraction (IE) aims to build IE systems from the unannotated text. It is challenging due to involving little human intervention. Challenging but worthwhile, zero-shot IE reduces the time and effort that data labeling takes. Recent efforts on large language models (LLMs, e.g., GPT-3, ChatGPT) show promising performance on zero-shot settings, thus inspiring us to explore prompt-based methods. In this work, we ask whether strong IE models can be constructed by directly prompting LLMs. Specifically, we transform the zero-shot IE task into a multi-turn question-answering problem with a two-stage framework (ChatIE). With the power of ChatGPT, we extensively evaluate our framework on three IE tasks: entity-relation triple extract, named entity recognition, and event extraction. Empirical results on six datasets across two languages show that ChatIE achieves impressive performance and even surpasses some full-shot models on several datasets (e.g., NYT11-HRL). We believe that our work could shed light on building IE models with limited resources.
Code (1)
Tasks
Event Extractionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Question AnsweringMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
DE-NER : Zero-shot Named Entity Recognition via Dialogue Elicitation of Large Language Models
Recent advancements of zero-shot Named Entity Recognition (NER) establish strong baselines by formulating sequence labeling into question answering where Large Language Models (LLMs) can be naturally adopted. However, ex…
Question AnsweringZeroShotCeres: Zero-Shot Relation Extraction from Semi-Structured Webpages
In many documents, such as semi-structured webpages, textual semantics are augmented with additional information conveyed using visual elements including layout, font size, and color. Prior work on information extraction…
Graph Neural NetworkRelationRelation ExtractionAn Empirical Study of Pre-trained Transformers for Arabic Information Extraction
Multilingual pre-trained Transformers, such as mBERT (Devlin et al., 2019) and XLM-RoBERTa (Conneau et al., 2020a), have been shown to enable the effective cross-lingual zero-shot transfer. However, their performance on …
Cross-Lingual TransferLanguage Modellingnamed-entity-recognitionNamed Entity Recognition+8GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extraction
Large Language Models (LLMs) combined with instruction tuning have made significant progress when generalizing to unseen tasks. However, they have been less successful in Information Extraction (IE), lagging behind task-…
Event Argument ExtractionEvent ExtractionLanguage ModelingLanguage Modelling+7Zero-Shot Information Extraction as a Unified Text-to-Triple Translation
We cast a suite of information extraction tasks into a text-to-triple translation framework. Instead of solving each task relying on task-specific datasets and models, we formalize the task as a translation between task-…
Factual probeLanguage ModelingLanguage ModellingOpen Information Extraction+2