Improving Domain-Specific Retrieval by NLI Fine-Tuning
The aim of this article is to investigate the fine-tuning potential of natural language inference (NLI) data to improve information retrieval and ranking. We demonstrate this for both English and Polish languages, using data from one of the largest Polish e-commerce sites and selected open-domain datasets. We employ both monolingual and multilingual sentence encoders fine-tuned by a supervised method utilizing contrastive loss and NLI data. Our results point to the fact that NLI fine-tuning increases the performance of the models in both tasks and both languages, with the potential to improve mono- and multilingual models. Finally, we investigate uniformity and alignment of the embeddings to explain the effect of NLI-based fine-tuning for an out-of-domain use-case.
Code (0)
등록된 구현이 없습니다.
Tasks
Information RetrievalNatural Language InferenceRetrievalSentenceSimilar Papers 제목 키워드 기반
Parameter-Efficient Prompt Tuning Makes Generalized and Calibrated Neural Text Retrievers
Prompt tuning attempts to update few task-specific parameters in pre-trained models. It has achieved comparable performance to fine-tuning of the full parameter set on both language understanding and generation tasks. In…
RetrievalText RetrievalZero-shot GeneralizationDomain-Specific Text Embedding Models for Entity Resolution
General-purpose text embedding models are designed to capture semantic similarity but are not optimised for distinguishing entity records that represent the same real-world business or person. This limitation affects app…
Information RetrievalSemantic SimilarityEntity ResolutionRetrieval Augmented Generation for Domain-specific Question Answering
Question answering (QA) has become an important application in the advanced development of large language models. General pre-trained large language models for question-answering are not trained to properly understand th…
Language ModelingLanguage ModellingLarge Language ModelQuestion Answering+2Fine-Tuning or Fine-Failing? Debunking Performance Myths in Large Language Models
Large Language Models (LLMs) have the unique capability to understand and generate human-like text from input queries. When fine-tuned, these models show enhanced performance on domain-specific queries. OpenAI highlights…
Information RetrievalRAGRetrievalRetrieval-augmented GenerationORPHEAS: A Cross-Lingual Greek-English Embedding Model for Retrieval-Augmented Generation
Effective retrieval-augmented generation across bilingual Greek--English applications requires embedding models capable of capturing both domain-specific semantic relationships and cross-lingual semantic alignment. Exist…