Revisiting Sparse Retrieval for Few-shot Entity Linking
Entity linking aims to link ambiguous mentions to their corresponding entities in a knowledge base. One of the key challenges comes from insufficient labeled data for specific domains. Although dense retrievers have achieved excellent performance on several benchmarks, their performance decreases significantly when only a limited amount of in-domain labeled data is available. In such few-shot setting, we revisit the sparse retrieval method, and propose an ELECTRA-based keyword extractor to denoise the mention context and construct a better query expression. For training the extractor, we propose a distant supervision method to automatically generate training data based on overlapping tokens between mention contexts and entity descriptions. Experimental results on the ZESHEL dataset demonstrate that the proposed method outperforms state-of-the-art models by a significant margin across all test domains, showing the effectiveness of keyword-enhanced sparse retrieval.
Code (1)
Tasks
Entity LinkingRetrievalSimilar Papers 제목 키워드 기반
Early Stage Sparse Retrieval with Entity Linking
Despite the advantages of their low-resource settings, traditional sparse retrievers depend on exact matching approaches between high-dimensional bag-of-words (BoW) representations of both the queries and the collection.…
Entity LinkingInformation RetrievalRetrievalInformation Retrieval with Entity Linking
Despite the advantages of their low-resource settings, traditional sparse retrievers depend on exact matching approaches between high-dimensional bag-of-words (BoW) representations of both the queries and the collection.…
Entity LinkingInformation RetrievalRetrievalScalable Zero-shot Entity Linking with Dense Entity Retrieval
This paper introduces a conceptually simple, scalable, and highly effective BERT-based entity linking model, along with an extensive evaluation of its accuracy-speed trade-off. We present a two-stage zero-shot linking al…
Entity EmbeddingsEntity LinkingEntity RetrievalKnowledge Distillation+1Get the Point! Graph Enhanced Candidate Retrieval for Zero-shot Entity Linking
For the retrieval phase of the zero-shot entity linking task, BERT has been widely used to represent the mentions and entities with the sentence embeddings. However, the sentence embeddings obtained by BERT are dominated…
Entity LinkingEntity RetrievalGraph Neural NetworkRetrieval+4Improving Few-shot and Zero-shot Entity Linking with Coarse-to-Fine Lexicon-based Retriever
Few-shot and zero-shot entity linking focus on the tail and emerging entities, which are more challenging but closer to real-world scenarios. The mainstream method is the ''retrieve and rerank'' two-stage framework. In t…
Entity LinkingRetrieval