paper-with-me

홈 › Papers

ProxyMix: Proxy-based Mixup Training with Label Refinery for Source-Free Domain Adaptation

2022-05-29 · Yuhe Ding, Lijun Sheng, Jian Liang, Aihua Zheng, Ran He

Unsupervised domain adaptation (UDA) aims to transfer knowledge from a labeled source domain to an unlabeled target domain. Owing to privacy concerns and heavy data transmission, source-free UDA, exploiting the pre-trained source models instead of the raw source data for target learning, has been gaining popularity in recent years. Some works attempt to recover unseen source domains with generative models, however introducing additional network parameters. Other works propose to fine-tune the source model by pseudo labels, while noisy pseudo labels may misguide the decision boundary, leading to unsatisfied results. To tackle these issues, we propose an effective method named Proxy-based Mixup training with label refinery (ProxyMix). First of all, to avoid additional parameters and explore the information in the source model, ProxyMix defines the weights of the classifier as the class prototypes and then constructs a class-balanced proxy source domain by the nearest neighbors of the prototypes to bridge the unseen source domain and the target domain. To improve the reliability of pseudo labels, we further propose the frequency-weighted aggregation strategy to generate soft pseudo labels for unlabeled target data. The proposed strategy exploits the internal structure of target features, pulls target features to their semantic neighbors, and increases the weights of low-frequency classes samples during gradient updating. With the proxy domain and the reliable pseudo labels, we employ two kinds of mixup regularization, i.e., inter- and intra-domain mixup, in our framework, to align the proxy and the target domain, enforcing the consistency of predictions, thereby further mitigating the negative impacts of noisy labels. Experiments on three 2D image and one 3D point cloud object recognition benchmarks demonstrate that ProxyMix yields state-of-the-art performance for source-free UDA tasks.

📄 PDF Abstract BibTeX arXiv:2205.14566

Code (2)

yuhed/proxymix 공식 구현 pytorch
se111/side pytorch

Tasks

Domain AdaptationObject RecognitionSource-Free Domain AdaptationUnsupervised Domain Adaptation

Methods 이 논문이 사용한 방법론

Mixup Mixup is a data augmentation technique that generates a weighted combination of random image pairs from the training data. Given two images and their ground truth labels:…
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

ProxyDet: Synthesizing Proxy Novel Classes via Classwise Mixup for Open-Vocabulary Object Detection

2023-12-12 · JoonHyun Jeong, Geondo Park, Jayeon Yoo, Hyungsik Jung 외

Open-vocabulary object detection (OVOD) aims to recognize novel objects whose categories are not included in the training set. In order to classify these unseen classes during training, many OVOD frameworks leverage the …

object-detectionObject DetectionOpen-vocabulary object detectionOpen Vocabulary Object Detection

Label Refinery: Improving ImageNet Classification through Label Progression

2018-05-07 · Hessam Bagherinezhad, Maxwell Horton, Mohammad Rastegari, Ali Farhadi

Among the three main components (data, labels, and models) of any supervised learning system, data and models have been the main subjects of active research. However, studying labels and their properties has received ver…

ClassificationGeneral Classification

Dynamic Proxy-Mixing: Transferring Replay Controllers from Small to Large Models for Continual Instruction Tuning

2026-05-29 · Ibne Farabi Shihab, Fariya Afrin, Anuj Sharma arxiv

Continual instruction tuning updates a language model through a sequence of new domains, yet each update can progressively erode previously learned capabilities and alignment behavior. Replay is the standard mitigation, …

Distribution Aligning Refinery of Pseudo-label for Imbalanced Semi-supervised Learning

2020-07-17 · NeurIPS 2020 12 · Jaehyung Kim, Youngbum Hur, Sejun Park, Eunho Yang 외

While semi-supervised learning (SSL) has proven to be a promising way for leveraging unlabeled data when labeled data is scarce, the existing SSL algorithms typically assume that training class distributions are balanced…

Pseudo Label

MrTF: Model Refinery for Transductive Federated Learning

2023-05-07 · Xin-Chun Li, Yang Yang, De-Chuan Zhan

We consider a real-world scenario in which a newly-established pilot project needs to make inferences for newly-collected data with the help of other parties under privacy protection policies. Current federated learning …

Federated Learningmodel