paper-with-me

Papers

ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPT

2023-02-20 · Xiang Wei, Xingyu Cui, Ning Cheng, Xiaobin Wang, Xin Zhang, Shen Huang, Pengjun Xie, Jinan Xu, Yufeng Chen, Meishan Zhang, Yong Jiang, Wenjuan Han

Zero-shot information extraction (IE) aims to build IE systems from the unannotated text. It is challenging due to involving little human intervention. Challenging but worthwhile, zero-shot IE reduces the time and effort that data labeling takes. Recent efforts on large language models (LLMs, e.g., GPT-3, ChatGPT) show promising performance on zero-shot settings, thus inspiring us to explore prompt-based methods. In this work, we ask whether strong IE models can be constructed by directly prompting LLMs. Specifically, we transform the zero-shot IE task into a multi-turn question-answering problem with a two-stage framework (ChatIE). With the power of ChatGPT, we extensively evaluate our framework on three IE tasks: entity-relation triple extract, named entity recognition, and event extraction. Empirical results on six datasets across two languages show that ChatIE achieves impressive performance and even surpasses some full-shot models on several datasets (e.g., NYT11-HRL). We believe that our work could shed light on building IE models with limited resources.

📄 PDF Abstract BibTeX arXiv:2302.10205

Code (1)

cocacola-lab/chatie 공식 구현

Tasks

Event Extractionnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Question Answering

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Multi-Head Attention 설명 없음
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Weight Decay 설명 없음
Linear Warmup With Cosine Annealing Linear Warmup With Cosine Annealing is a learning rate schedule where we increase the learning rate linearly for $n$ updates and then anneal according to a cosine schedule…
Adam 설명 없음

Similar Papers 제목 키워드 기반

DE-NER : Zero-shot Named Entity Recognition via Dialogue Elicitation of Large Language Models

2026-08-01 · Xuankang Zhang, Jiangming Liu arxiv

Recent advancements of zero-shot Named Entity Recognition (NER) establish strong baselines by formulating sequence labeling into question answering where Large Language Models (LLMs) can be naturally adopted. However, ex…

Question Answering

ZeroShotCeres: Zero-Shot Relation Extraction from Semi-Structured Webpages

2020-05-14 · Colin Lockard, Prashant Shiralkar, Xin Luna Dong, Hannaneh Hajishirzi

In many documents, such as semi-structured webpages, textual semantics are augmented with additional information conveyed using visual elements including layout, font size, and color. Prior work on information extraction…

Graph Neural NetworkRelationRelation Extraction

An Empirical Study of Pre-trained Transformers for Arabic Information Extraction

2020-04-30 · EMNLP 2020 11 · Wuwei Lan, Yang Chen, Wei Xu, Alan Ritter

Multilingual pre-trained Transformers, such as mBERT (Devlin et al., 2019) and XLM-RoBERTa (Conneau et al., 2020a), have been shown to enable the effective cross-lingual zero-shot transfer. However, their performance on …

Cross-Lingual TransferLanguage Modellingnamed-entity-recognitionNamed Entity Recognition+8

GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extraction

2023-10-05 · Oscar Sainz, Iker García-Ferrero, Rodrigo Agerri, Oier Lopez de Lacalle 외

Large Language Models (LLMs) combined with instruction tuning have made significant progress when generalizing to unseen tasks. However, they have been less successful in Information Extraction (IE), lagging behind task-…

Event Argument ExtractionEvent ExtractionLanguage ModelingLanguage Modelling+7

Zero-Shot Information Extraction as a Unified Text-to-Triple Translation

2021-09-23 · EMNLP 2021 11 · Chenguang Wang, Xiao Liu, Zui Chen, Haoyun Hong 외

We cast a suite of information extraction tasks into a text-to-triple translation framework. Instead of solving each task relying on task-specific datasets and models, we formalize the task as a translation between task-…

Factual probeLanguage ModelingLanguage ModellingOpen Information Extraction+2