paper-with-me

홈 › Papers

SelectNAdapt: Support Set Selection for Few-Shot Domain Adaptation

2023-08-09 · Youssef Dawoud, Gustavo Carneiro, Vasileios Belagiannis

Generalisation of deep neural networks becomes vulnerable when distribution shifts are encountered between train (source) and test (target) domain data. Few-shot domain adaptation mitigates this issue by adapting deep neural networks pre-trained on the source domain to the target domain using a randomly selected and annotated support set from the target domain. This paper argues that randomly selecting the support set can be further improved for effectively adapting the pre-trained source models to the target domain. Alternatively, we propose SelectNAdapt, an algorithm to curate the selection of the target domain samples, which are then annotated and included in the support set. In particular, for the K-shot adaptation problem, we first leverage self-supervision to learn features of the target domain data. Then, we propose a per-class clustering scheme of the learned target domain features and select K representative target samples using a distance-based scoring function. Finally, we bring our selection setup towards a practical ground by relying on pseudo-labels for clustering semantically similar target domain samples. Our experiments show promising results on three few-shot domain adaptation benchmarks for image recognition compared to related approaches and the standard random selection.

📄 PDF Abstract BibTeX arXiv:2308.04946

Code (1)

yussef93/selectnadapticcvw 공식 구현 pytorch

Tasks

ClusteringDomain Adaptation

Similar Papers 제목 키워드 기반

Few-shot Adaptation of Multi-modal Foundation Models: A Survey

2024-01-03 · Fan Liu, Tianshu Zhang, Wenwen Dai, Wenwen Cai 외

Multi-modal (vision-language) models, such as CLIP, are replacing traditional supervised pre-training models (e.g., ImageNet-based pre-training) as the new generation of visual foundation models. These models with robust…

Domain GeneralizationModel SelectionSurvey

Toward domain-specific machine translation and quality estimation systems

2026-03-26 · Javad Pourmostafa Roshan Sharami arxiv

Machine Translation (MT) and Quality Estimation (QE) perform well in general domains but degrade under domain mismatch. This dissertation studies how to adapt MT and QE systems to specialized domains through a set of dat…

Machine TranslationData AugmentationDomain Adaptation

Enhancing Test Time Adaptation with Few-shot Guidance

2024-09-02 · Siqi Luo, Yi Xin, Yuntao Du, Zhongwei Wan 외

Deep neural networks often encounter significant performance drops while facing with domain shifts between training (source) and test (target) data. To address this issue, Test Time Adaptation (TTA) methods have been pro…

Diversitydomain classificationPseudo LabelTest-time Adaptation

Domain Adaptation with BERT-based Domain Classification and Data Selection

2019-11-01 · WS 2019 11 · Xiaofei Ma, Peng Xu, Zhiguo Wang, Ramesh Nallapati 외

The performance of deep neural models can deteriorate substantially when there is a domain shift between training and test data. For example, the pre-trained BERT model can be easily fine-tuned with just one additional o…

ClassificationDomain Adaptationdomain classificationGeneral Classification

Few-Shot Domain Adaptation for Named-Entity Recognition via Joint Constrained k-Means and Subspace Selection

2024-11-30 · Ayoub Hammal, Benno Uthayasooriyar, Caio Corro

Named-entity recognition (NER) is a task that typically requires large annotated datasets, which limits its applicability across domains with varying entity definitions. This paper addresses few-shot NER, aiming to trans…

Domain Adaptationfew-shot-nerFew-shot NERnamed-entity-recognition+3