paper-with-me

홈 › Papers

Dense Retrieval Adaptation using Target Domain Description

2023-07-06 · Helia Hashemi, Yong Zhuang, Sachith Sri Ram Kothur, Srivas Prasad, Edgar Meij, W. Bruce Croft

In information retrieval (IR), domain adaptation is the process of adapting a retrieval model to a new domain whose data distribution is different from the source domain. Existing methods in this area focus on unsupervised domain adaptation where they have access to the target document collection or supervised (often few-shot) domain adaptation where they additionally have access to (limited) labeled data in the target domain. There also exists research on improving zero-shot performance of retrieval models with no adaptation. This paper introduces a new category of domain adaptation in IR that is as-yet unexplored. Here, similar to the zero-shot setting, we assume the retrieval model does not have access to the target document collection. In contrast, it does have access to a brief textual description that explains the target domain. We define a taxonomy of domain attributes in retrieval tasks to understand different properties of a source domain that can be adapted to a target domain. We introduce a novel automatic data construction pipeline that produces a synthetic document collection, query set, and pseudo relevance labels, given a textual domain description. Extensive experiments on five diverse target domains show that adapting dense retrieval models using the constructed synthetic data leads to effective retrieval performance on the target domain.

📄 PDF Abstract BibTeX arXiv:2307.02740

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationInformation RetrievalRetrievalUnsupervised Domain Adaptation

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Domain Adaptation for Dense Retrieval and Conversational Dense Retrieval through Self-Supervision by Meticulous Pseudo-Relevance Labeling

2024-03-13 · Minghan Li, Eric Gaussier

Recent studies have demonstrated that the ability of dense retrieval models to generalize to target domains with different distributions is limited, which contrasts with the results obtained with interaction-based models…

Conversational SearchDomain AdaptationRetrieval

GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Dense retrieval approaches can overcome the lexical gap and lead to significantly improved search results. However, they require large amounts of training data which is not available for most domains. As shown in previou…

Domain AdaptationRetrievalUnsupervised Domain Adaptation

GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval

2021-12-14 · NAACL 2022 7 · Kexin Wang, Nandan Thakur, Nils Reimers, Iryna Gurevych

Dense retrieval approaches can overcome the lexical gap and lead to significantly improved search results. However, they require large amounts of training data which is not available for most domains. As shown in previou…

Domain AdaptationRetrievalUnsupervised Domain AdaptationZero-shot Text Search

Sparse MLLM Anchors, Dense Adaptation: Breaking the Self-Referential Loop in Wild Test-Time Adaptation

2026-09-15 · Zhenbin Wang, Lei Zhang, Lituan Wang, Yan Wang 외 arxiv

Wild test-time adaptation (WTTA) updates a source model online under small test batches, concurrent distribution shifts, and time-varying class imbalance. Most WTTA methods derive their adaptation signals, including pred…

Test-time Adaptation

Disentangled Modeling of Domain and Relevance for Adaptable Dense Retrieval

2022-08-11 · Jingtao Zhan, Qingyao Ai, Yiqun Liu, Jiaxin Mao 외

Recent advance in Dense Retrieval (DR) techniques has significantly improved the effectiveness of first-stage retrieval. Trained with large-scale supervised data, DR models can encode queries and documents into a low-dim…

Ad-Hoc Information RetrievalDomain AdaptationRetrieval