Retrieval Augmented Instruction Tuning for Open NER with Large Language Models

2024-06-25 · Tingyu Xie, Jian Zhang, Yan Zhang, Yuanyuan Liang, Qi Li, Hongwei Wang

The strong capability of large language models (LLMs) has been applied to information extraction (IE) through either retrieval augmented prompting or instruction tuning (IT). However, the best way to incorporate information with LLMs for IE remains an open question. In this paper, we explore Retrieval Augmented Instruction Tuning (RA-IT) for IE, focusing on the task of open named entity recognition (NER). Specifically, for each training sample, we retrieve semantically similar examples from the training dataset as the context and prepend them to the input of the original instruction. To evaluate our RA-IT approach more thoroughly, we construct a Chinese IT dataset for open NER and evaluate RA-IT in both English and Chinese scenarios. Experimental results verify the effectiveness of RA-IT across various data sizes and in both English and Chinese scenarios. We also conduct thorough studies to explore the impacts of various retrieval strategies in the proposed RA-IT framework. Code and data are available at: https://github.com/Emma1066/Retrieval-Augmented-IT-OpenNER

📄 PDF Abstract BibTeX arXiv:2406.17305

Code (1)

emma1066/retrieval-augmented-it-openner 공식 구현 pytorch

Tasks

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER Retrieval

Benchmarking Retrieval-Augmented Generation in Multi-Modal Contexts

2025-02-24 · Zhenghao Liu, Xingsheng Zhu, Tianshuo Zhou, Xinyi Zhang 외

This paper introduces Multi-Modal Retrieval-Augmented Generation (M^2RAG), a benchmark designed to evaluate the effectiveness of Multi-modal Large Language Models (MLLMs) in leveraging knowledge from multi-modal retrieva…

Benchmarking Fact Verification Image Captioning Question Answering+4

Retrieval-Augmented Instruction Tuning for Automated Process Engineering Calculations : A Tool-Chaining Problem-Solving Framework with Attributable Reflection

2024-08-28 · Sagar Srinivas Sakhinana, Geethan Sannidhi, Venkataramana Runkana

The current technology landscape lacks a foundational AI model for solving process engineering calculations. In this work, we introduce a novel autonomous agent framework leveraging Retrieval-Augmented Instruction-Tuning…

Code Generation knowledge editing Retrieval

HIRAG: Hierarchical-Thought Instruction-Tuning Retrieval-Augmented Generation

2025-07-08 · YiHan Jiao, ZheHao Tan, Dan Yang, DuoLin Sun 외 arxiv

Retrieval-augmented generation (RAG) has become a fundamental paradigm for addressing the challenges faced by large language models in handling real-time information and domain-specific problems. Traditional RAG systems …

RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMs

2024-07-02 · Yue Yu, Wei Ping, Zihan Liu, Boxin Wang 외

Large language models (LLMs) typically utilize the top-k contexts from a retriever in retrieval-augmented generation (RAG). In this work, we propose a novel instruction fine-tuning framework RankRAG, which instruction-tu…

Answer Generation Question Answering RAG Retrieval+1

Unsupervised Text Representation Learning via Instruction-Tuning for Zero-Shot Dense Retrieval

2024-09-24 · Qiuhai Zeng, Zimeng Qiu, Dae Yon Hwang, Xin He 외

Dense retrieval systems are commonly used for information retrieval (IR). They rely on learning text representations through an encoder and usually require supervised modeling via labelled data which can be costly to obt…

Information Retrieval Question Generation Question-Generation Representation Learning+1