Combining Deep Neural Reranking and Unsupervised Extraction for Multi-Query Focused Summarization
The CrisisFACTS Track aims to tackle challenges such as multi-stream fact-finding in the domain of event tracking; participants' systems extract important facts from several disaster-related events while incorporating the temporal order. We propose a combination of retrieval, reranking, and the well-known Integer Linear Programming (ILP) and Maximal Marginal Relevance (MMR) frameworks. In the former two modules, we explore various methods including an entity-based baseline, pre-trained and fine-tuned Question Answering systems, and ColBERT. We then use the latter module as an extractive summarization component by taking diversity and novelty criteria into account. The automatic scoring runs show strong results across the evaluation setups but also reveal shortcomings and challenges.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityExtractive SummarizationQuery-focused SummarizationQuestion AnsweringRerankingRetrievalSimilar Papers 제목 키워드 기반
InstUPR : Instruction-based Unsupervised Passage Reranking with Large Language Models
This paper introduces InstUPR, an unsupervised passage reranking method based on large language models (LLMs). Different from existing approaches that rely on extensive training with query-document pairs or retrieval-spe…
Instruction FollowingPassage RerankingRerankingRetrievalA Method of Query Graph Reranking for Knowledge Base Question Answering
This paper presents a novel reranking method to better choose the optimal query graph, a sub-graph of knowledge graph, to retrieve the answer for an input question in Knowledge Base Question Answering (KBQA). Existing me…
Graph RankingKnowledge Base Question AnsweringQuestion AnsweringRerankingTest-Time Training for Zero-Resource Dense Retrieval Reranking
Dense retrievers excel at first-stage candidate generation but lack effective reranking in zero-resource settings. Existing approaches face a fundamental dilemma: cross-encoders deliver strong reranking quality but requi…
Domain GeneralizationAugTriever: Unsupervised Dense Retrieval and Domain Adaptation by Scalable Data Augmentation
Dense retrievers have made significant strides in text retrieval and open-domain question answering. However, most of these achievements have relied heavily on extensive human-annotated supervision. In this study, we aim…
Data AugmentationDomain AdaptationOpen-Domain Question AnsweringQuestion Answering+3Efficient Title Reranker for Fast and Improved Knowledge-Intense NLP
In recent RAG approaches, rerankers play a pivotal role in refining retrieval accuracy with the ability of revealing logical relations for each pair of query and text. However, existing rerankers are required to repeated…
RAGRerankingRetrieval