A Proposed Large Language Model-Based Smart Search for Archive System
This study presents a novel framework for smart search in digital archival systems, leveraging the capabilities of Large Language Models (LLMs) to enhance information retrieval. By employing a Retrieval-Augmented Generation (RAG) approach, the framework enables the processing of natural language queries and transforming non-textual data into meaningful textual representations. The system integrates advanced metadata generation techniques, a hybrid retrieval mechanism, a router query engine, and robust response synthesis, the results proved search precision and relevance. We present the architecture and implementation of the system and evaluate its performance in four experiments concerning LLM efficiency, hybrid retrieval optimizations, multilingual query handling, and the impacts of individual components. Obtained results show significant improvements over conventional approaches and have demonstrated the potential of AI-powered systems to transform modern archival practices.
Code (0)
등록된 구현이 없습니다.
Tasks
Information RetrievalLanguage ModelingLanguage ModellingLarge Language ModelNatural Language QueriesRAGRetrievalRetrieval-augmented GenerationSimilar Papers 제목 키워드 기반
TALN Archives : a digital archive of French research articles in Natural Language Processing (TALN Archives : une archive num\'erique francophone des articles de recherche en Traitement Automatique de la Langue) [in French]
Zero-shot Audio Topic Reranking using Large Language Models
Multimodal Video Search by Examples (MVSE) investigates using video clips as the query term for information retrieval, rather than the more traditional text query. This enables far richer search modalities such as images…
Fact CheckingInformation RetrievalRerankingRetrievalWeatherArchive-Bench: Benchmarking Retrieval-Augmented Reasoning for Historical Weather Archives
Historical archives on weather events are collections of enduring primary source records that offer rich, untapped narratives of how societies have experienced and responded to extreme weather events. These qualitative a…
How to Search the Internet Archive Without Indexing It
Significant parts of cultural heritage are produced on the web during the last decades. While easy accessibility to the current web is a good baseline, optimal access to the past web faces several challenges. This includ…
RetrievalThe Language Archive --- a new hub for language resources
This contribution presents The Language Archive (TLA), a new unit at the MPI for Psycholinguistics, discussing the current developments in management of scientific data, considering the need for new data research infra…
Language AcquisitionManagement