COCA: Classifier-Oriented Calibration via Textual Prototype for Source-Free Universal Domain Adaptation
Universal domain adaptation (UniDA) aims to address domain and category shifts across data sources. Recently, due to more stringent data restrictions, researchers have introduced source-free UniDA (SF-UniDA). SF-UniDA methods eliminate the need for direct access to source samples when performing adaptation to the target domain. However, existing SF-UniDA methods still require an extensive quantity of labeled source samples to train a source model, resulting in significant labeling costs. To tackle this issue, we present a novel plug-and-play classifier-oriented calibration (COCA) method. COCA, which exploits textual prototypes, is designed for the source models based on few-shot learning with vision-language models (VLMs). It endows the VLM-powered few-shot learners, which are built for closed-set classification, with the unknown-aware ability to distinguish common and unknown classes in the SF-UniDA scenario. Crucially, COCA is a new paradigm to tackle SF-UniDA challenges based on VLMs, which focuses on classifier instead of image encoder optimization. Experiments show that COCA outperforms state-of-the-art UniDA and SF-UniDA models.
Code (1)
Tasks
Domain AdaptationFew-Shot LearningLanguage ModellingUniversal Domain AdaptationSimilar Papers 제목 키워드 기반
Distantly Supervised Named Entity Recognition with Category-Oriented Confidence Calibration
In this work, we study the noisy-labeled named entity recognition under distant supervision setting. Considering that most NER systems based on confidence estimation deal with noisy labels ignoring the fact that model ha…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERGRR-CoCa: Leveraging LLM Mechanisms in Multimodal Model Architectures
State-of-the-art (SOTA) image and text generation models are multimodal models that have many similarities to large language models (LLMs). Despite achieving strong performances, leading foundational multimodal model arc…
Text GenerationVariational Quantum Classifiers for Natural-Language Text
As part of the recent research effort on quantum natural language processing (QNLP), variational quantum sentence classifiers (VQSCs) have been implemented and supported in lambeq / DisCoPy, based on the DisCoCat model o…
coreference-resolutionCoreference ResolutionSentenceSentiment Analysis+1Physics-Informed Structure Anchoring With Capture-Aware Prototype Calibration for Cross-Environment RF Fingerprinting
Radio frequency fingerprint identification (RFFI) exploits transmitter-specific hardware imperfections as physicallayer identity cues for Internet of Things (IoT) devices, but deep models often degrade across acquisition…
Representation LearningEnhancing Generalized Few-Shot Semantic Segmentation via Effective Knowledge Transfer
Generalized few-shot semantic segmentation (GFSS) aims to segment objects of both base and novel classes, using sufficient samples of base classes and few samples of novel classes. Representative GFSS approaches typicall…
Classifier calibrationFew-Shot Semantic SegmentationGeneralized Few-Shot Semantic SegmentationSemantic Segmentation+1