paper-with-me

홈 › Papers

Creating a Fine Grained Entity Type Taxonomy Using LLMs

2024-02-19 · Michael Gunn, Dohyun Park, Nidhish Kamath

In this study, we investigate the potential of GPT-4 and its advanced iteration, GPT-4 Turbo, in autonomously developing a detailed entity type taxonomy. Our objective is to construct a comprehensive taxonomy, starting from a broad classification of entity types - including objects, time, locations, organizations, events, actions, and subjects - similar to existing manually curated taxonomies. This classification is then progressively refined through iterative prompting techniques, leveraging GPT-4's internal knowledge base. The result is an extensive taxonomy comprising over 5000 nuanced entity types, which demonstrates remarkable quality upon subjective evaluation. We employed a straightforward yet effective prompting strategy, enabling the taxonomy to be dynamically expanded. The practical applications of this detailed taxonomy are diverse and significant. It facilitates the creation of new, more intricate branches through pattern-based combinations and notably enhances information extraction tasks, such as relation extraction and event argument extraction. Our methodology not only introduces an innovative approach to taxonomy creation but also opens new avenues for applying such taxonomies in various computational linguistics and AI-related fields.

📄 PDF Abstract BibTeX arXiv:2402.12557

Code (0)

등록된 구현이 없습니다.

Tasks

Event Argument ExtractionRelation Extraction

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Multi-Head Attention 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Description-Based Zero-shot Fine-Grained Entity Typing

2019-06-01 · NAACL 2019 6 · Rasha Obeidat, Xiaoli Fern, Hamed Shahbazi, Prasad Tadepalli

Fine-grained Entity typing (FGET) is the task of assigning a fine-grained type from a hierarchy to entity mentions in the text. As the taxonomy of types evolves continuously, it is desirable for an entity typing system t…

Entity TypingVocal Bursts Type Prediction

Zero-Shot Open Entity Typing as Type-Compatible Grounding

2019-07-07 · EMNLP 2018 10 · Ben Zhou, Daniel Khashabi, Chen-Tse Tsai, Dan Roth

The problem of entity-typing has been studied predominantly in supervised learning fashion, mostly with task-specific annotations (for coarse types) and sometimes with distant supervision (for fine types). While such app…

Entity TypingNERVocal Bursts Type Prediction

From Ultra-Fine to Fine: Fine-tuning Ultra-Fine Entity Typing Models to Fine-grained

2023-12-11 · Hongliang Dai, Ziqian Zeng

For the task of fine-grained entity typing (FET), due to the use of a large number of entity types, it is usually considered too costly to manually annotating a training dataset that contains an ample number of examples …

Entity Typing

Interpretable Entity Representations through Large-Scale Typing

2020-04-30 · Findings of the Association for Computational Linguistics 2020 · Yasumasa Onoe, Greg Durrett

In standard methodology for natural language processing, entities in text are typically embedded in dense vector spaces with pre-trained models. The embeddings produced this way are effective when fed into downstream mod…

Entity EmbeddingsEntity Typing

Fine-Grained Entity Typing in Hyperbolic Space

2019-06-06 · WS 2019 8 · Federico López, Benjamin Heinzerling, Michael Strube

How can we represent hierarchical information present in large type inventories for entity typing? We study the ability of hyperbolic embeddings to capture hierarchical relations between mentions in context and their tar…

Entity TypingVocal Bursts Type Prediction