paper-with-me

Papers

Dynamic Injection of Entity Knowledge into Dense Retrievers

2025-07-05 · Ikuya Yamada, Ryokan Ri, Takeshi Kojima, Yusuke Iwasawa, Yutaka Matsuo arxiv

Dense retrievers often struggle with queries involving less-frequent entities due to their limited entity knowledge. We propose the Knowledgeable Passage Retriever (KPR), a BERT-based retriever enhanced with a context-entity attention layer and dynamically updatable entity embeddings. This design enables KPR to incorporate external entity knowledge without retraining. Experiments on three datasets demonstrate that KPR consistently improves retrieval accuracy, with particularly large gains on the EntityQuestions dataset. When built on the off-the-shelf bge-base retriever, KPR achieves state-of-the-art performance among similarly sized models on two datasets. Models and code are released at https://github.com/knowledgeable-embedding/knowledgeable-embedding.

📄 PDF Abstract BibTeX arXiv:2507.03922

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Few-Shot Generative Model Adaption via Identity Injection and Preservation

2026-03-24 · Yeqi He, Liang Li, Jiehua Zhang, Yaoqi Sun 외 arxiv

Training generative models with limited data presents severe challenges of mode collapse. A common approach is to adapt a large pretrained generative model upon a target domain with very few samples (fewer than 10), know…

Enhancing Document-level Relation Extraction by Entity Knowledge Injection

2022-07-23 · Xinyi Wang, Zitao Wang, Weijian Sun, Wei Hu

Document-level relation extraction (RE) aims to identify the relations between entities throughout an entire document. It needs complex reasoning skills to synthesize various knowledge such as coreferences and commonsens…

Document-level Relation ExtractionKnowledge GraphsRelationRelation Extraction

Improving and Diagnosing Knowledge-Based Visual Question Answering via Entity Enhanced Knowledge Injection

2021-12-13 · Diego Garcia-Olano, Yasumasa Onoe, Joydeep Ghosh

Knowledge-Based Visual Question Answering (KBVQA) is a bi-modal task requiring external world knowledge in order to correctly answer a text question and associated image. Recent single modality text work has shown knowle…

Common Sense ReasoningKnowledge Graph EmbeddingsQuestion AnsweringVisual Question Answering+2

KILM: Knowledge Injection into Encoder-Decoder Language Models

2023-02-17 · Yan Xu, Mahdi Namazifar, Devamanyu Hazarika, Aishwarya Padmakumar 외

Large pre-trained language models (PLMs) have been shown to retain implicit knowledge within their parameters. To enhance this implicit knowledge, we propose Knowledge Injection into Language Models (KILM), a novel appro…

DecoderEntity Disambiguation

KEHRL: Learning Knowledge-Enhanced Language Representations with Hierarchical Reinforcement Learning

2024-06-24 · Dongyang Li, Taolin Zhang, Longtao Huang, Chengyu Wang 외

Knowledge-enhanced pre-trained language models (KEPLMs) leverage relation triples from knowledge graphs (KGs) and integrate these external data sources into language models via self-supervised learning. Previous works tr…

Hierarchical Reinforcement LearningKnowledge GraphsNatural Language Understandingreinforcement-learning+3