paper-with-me

홈 › Papers

Reiterative Domain Aware Multi-Target Adaptation

2021-08-26 · Sudipan Saha, Shan Zhao, Nasrullah Sheikh, Xiao Xiang Zhu

Most domain adaptation methods focus on single-source-single-target adaptation settings. Multi-target domain adaptation is a powerful extension in which a single classifier is learned for multiple unlabeled target domains. To build a multi-target classifier, it is important to have: a feature extractor that generalizes well across domains; and effective aggregation of features from the labeled source and different unlabeled target domains. Towards the first, we use the recently popular Transformer as a feature extraction backbone. Towards the second, we use a co-teaching-based approach using a dual-classifier head, one of which is based on the graph neural network. The proposed approach uses a sequential adaptation strategy that adapts one domain at a time starting from the target domains that are more similar to the source, assuming that the network finds it easier to adapt to such target domains. After adapting on each target, samples with a softmax-based confidence score greater than a threshold are added to the pseudo-source, thus aggregating knowledge from different domains. However, softmax is not entirely trustworthy as a confidence score and may generate a high score for unreliable samples if trained for many iterations. To mitigate this effect, we adopt a reiterative approach, where we reduce target adaptation iterations, however, reiterate multiple times over the target domains. The experimental evaluation on the Office-Home, Office-31 and DomainNet datasets shows significant improvement over the existing methods. We have achieved 10.7$\%$ average improvement in Office-Home dataset over the state-of-art methods.

📄 PDF Abstract BibTeX arXiv:2109.00919

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationGraph Neural NetworkMulti-target Domain Adaptation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Known-class Aware Self-ensemble for Open Set Domain Adaptation

2019-05-03 · Qing Lian, Wen Li, Lin Chen, Lixin Duan

Existing domain adaptation methods generally assume different domains have the identical label space, which is quite restrict for real-world applications. In this paper, we focus on a more realistic and challenging case …

Domain Adaptation

PTPP-Aware Adaptation Scaling Laws: Predicting Domain-Adaptation Performance at Unseen Pre-Training Budgets

2025-10-27 · Etienne Goffinet, Shane Bergsma, Avraham Sheinin, Natalia Vassilieva 외 arxiv

Continual pre-training (CPT) for domain adaptation must balance target-domain gains with stability on the base domain. Existing CPT scaling laws typically assume a fixed pre-training budget, which limits their ability to…

Domain Adaptation

Revisiting the Domain Shift and Sample Uncertainty in Multi-source Active Domain Transfer

2023-11-21 · CVPR 2024 1 · Wenqiao Zhang, Zheqi Lv, Hao Zhou, Jia-Wei Liu 외

Active Domain Adaptation (ADA) aims to maximally boost model adaptation in a new target domain by actively selecting a limited number of target data to annotate.This setting neglects the more practical scenario where tra…

DiversityDomain AdaptationTransfer Learning

Uncertainty Awareness on Unsupervised Domain Adaptation for Time Series Data

2025-08-26 · Weide Liu, Xiaoyang Zhong, Lu Wang, Jingwen Hou 외 arxiv

Unsupervised domain adaptation methods seek to generalize effectively on unlabeled test data, especially when encountering the common challenge in time series data that distribution shifts occur between training and test…

Unsupervised Domain Adaptation

UPL-SFDA: Uncertainty-aware Pseudo Label Guided Source-Free Domain Adaptation for Medical Image Segmentation

2023-09-19 · Jianghao Wu, Guotai Wang, Ran Gu, Tao Lu 외

Domain Adaptation (DA) is important for deep learning-based medical image segmentation models to deal with testing images from a new target domain. As the source-domain data are usually unavailable when a trained model i…

Brain SegmentationDomain AdaptationImage SegmentationMedical Image Segmentation+5