Multi-Field Adaptive Retrieval
Document retrieval for tasks such as search and retrieval-augmented generation typically involves datasets that are unstructured: free-form text without explicit internal structure in each document. However, documents can have a structured form, consisting of fields such as an article title, message body, or HTML header. To address this gap, we introduce Multi-Field Adaptive Retrieval (MFAR), a flexible framework that accommodates any number of and any type of document indices on structured data. Our framework consists of two main steps: (1) the decomposition of an existing document into fields, each indexed independently through dense and lexical methods, and (2) learning a model which adaptively predicts the importance of a field by conditioning on the document query, allowing on-the-fly weighting of the most likely field(s). We find that our approach allows for the optimized use of dense versus lexical representations across field types, significantly improves in document ranking over a number of existing retrievers, and achieves state-of-the-art performance for multi-field structured data.
Code (0)
등록된 구현이 없습니다.
Tasks
Document RankingRetrievalRetrieval-augmented GenerationSimilar Papers 제목 키워드 기반
Adaptive Hopfield Network: Rethinking Similarities in Associative Memory
Associative memory models are content-addressable memory systems fundamental to biological intelligence and are notable for their high interpretability. However, existing models evaluate the quality of retrieval based on…
Multiple Instance LearningImage ClassificationAdaptive Confidence Multi-View Hashing for Multimedia Retrieval
The multi-view hash method converts heterogeneous data from multiple views into binary hash codes, which is one of the critical technologies in multimedia retrieval. However, the current methods mainly explore the comple…
RetrievalMCA: 2D-3D Retrieval with Noisy Labels via Multi-level Adaptive Correction and Alignment
With the increasing availability of 2D and 3D data, significant advancements have been made in the field of cross-modal retrieval. Nevertheless, the existence of imperfect annotations presents considerable challenges, de…
Cross-Modal RetrievalEvolutionary algorithm based adaptive navigation in information retrieval interfaces
In computer interfaces in general, especially in information retrieval tasks, it is important to be able to quickly find and retrieve information. State of the art approach, used, for example, in search engines, is not e…
Information RetrievalRetrievalAdaptiveEmbed: Sample-Adaptive Multi-Vector Representation for Multimodal Retrieval
Multi-vector representations have emerged as an effective paradigm for multimodal retrieval, representing each sample with multiple complementary embeddings to capture fine-grained cross-modal information. However, exist…
Contrastive Learning