Conversational Factor Information Retrieval Model (ConFIRM)
This paper introduces the Conversational Factor Information Retrieval Method (ConFIRM), a novel approach to fine-tuning large language models (LLMs) for domain-specific retrieval tasks. ConFIRM leverages the Five-Factor Model of personality to generate synthetic datasets that accurately reflect target population characteristics, addressing data scarcity in specialized domains. We demonstrate ConFIRM's effectiveness through a case study in the finance sector, fine-tuning a Llama-2-7b model using personality-aligned data from the PolyU-Asklora Fintech Adoption Index. The resulting model achieved 91% accuracy in classifying financial queries, with an average inference time of 0.61 seconds on an NVIDIA A100 GPU. ConFIRM shows promise for creating more accurate and personalized AI-driven information retrieval systems across various domains, potentially mitigating issues of hallucinations and outdated information in LLMs deployed
Code (1)
Tasks
GPUInformation Retrievalintent-classificationIntent Classificationmodelparameter-efficient fine-tuningRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Adaptive Personalized Conversational Information Retrieval
Personalized conversational information retrieval (CIR) systems aim to satisfy users' complex information needs through multi-turn interactions by considering user profiles. However, not all search queries require person…
Information RetrievalAligning Query Representation with Rewritten Query and Relevance Judgments in Conversational Search
Conversational search supports multi-turn user-system interactions to solve complex information needs. Different from the traditional single-turn ad-hoc search, conversational search encounters a more challenging problem…
Conversational SearchHistory-Aware Conversational Dense Retrieval
Conversational search facilitates complex information retrieval by enabling multi-turn interactions between users and the system. Supporting such interactions requires a comprehensive understanding of the conversational …
Conversational SearchInformation RetrievalRetrievalCONVERSER: Few-Shot Conversational Dense Retrieval with Synthetic Data Generation
Conversational search provides a natural interface for information retrieval (IR). Recent approaches have demonstrated promising results in applying dense retrieval to conversational IR. However, training dense retriever…
Conversational SearchIn-Context LearningInformation RetrievalRetrieval+1Dense Passage Retrieval in Conversational Search
Information retrieval systems have traditionally relied on exact term match methods such as BM25 for first-stage retrieval. However, recent advancements in neural network-based techniques have introduced a new method cal…
Conversational SearchInformation RetrievalOpen-Domain Question AnsweringPassage Retrieval+2