On Correlating Factors for Domain Adaptation Performance
Dense retrievers have demonstrated significant potential for neural information retrieval; however, they lack robustness to domain shifts, limiting their efficacy in zero-shot settings across diverse domains. In this paper, we set out to analyze the possible factors that lead to successful domain adaptation of dense retrievers. We include domain similarity proxies between generated queries to test and source domains. Furthermore, we conduct a case study comparing two powerful domain adaptation techniques. We find that generated query type distribution is an important factor, and generating queries that share a similar domain to the test documents improves the performance of domain adaptation methods. This study further emphasizes the importance of domain-tailored generated queries.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationInformation RetrievalRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Domain-Specificity Inducing Transformers for Source-Free Domain Adaptation
Conventional Domain Adaptation (DA) methods aim to learn domain-invariant feature representations to improve the target adaptation performance. However, we motivate that domain-specificity is equally important since in-d…
DisentanglementDomain AdaptationSource-Free Domain AdaptationSpecificityDAOT: Domain-Agnostically Aligned Optimal Transport for Domain-Adaptive Crowd Counting
Domain adaptation is commonly employed in crowd counting to bridge the domain gaps between different datasets. However, existing domain adaptation methods tend to focus on inter-dataset differences while overlooking the …
Crowd CountingDomain AdaptationSSIMWord Matters: What Influences Domain Adaptation in Summarization?
Domain adaptation aims to enable Large Language Models (LLMs) to generalize domain datasets unseen effectively during the training phase. However, factors such as the size of the model parameters and the scale of trainin…
Domain AdaptationPredicting the Success of Domain Adaptation in Text Similarity
Transfer learning methods, and in particular domain adaptation, help exploit labeled data in one domain to improve the performance of a certain task in another domain. However, it is still not clear what factors affect t…
DescriptiveDomain Adaptationtext similarityTransfer LearningImproved Multi-Source Domain Adaptation by Preservation of Factors
Domain Adaptation (DA) is a highly relevant research topic when it comes to image classification with deep neural networks. Combining multiple source domains in a sophisticated way to optimize a classification model can …
Domain Adaptationimage-classificationImage Classification