paper-with-me

Papers

Adapting Vision-Language Models Without Labels: A Comprehensive Survey

2025-08-07 · Hao Dong, Lijun Sheng, Jian Liang, Ran He, Eleni Chatzi, Olga Fink arxiv

Vision-Language Models (VLMs) have demonstrated remarkable generalization capabilities across a wide range of tasks. However, their performance often remains suboptimal when directly applied to specific downstream scenarios without task-specific adaptation. To enhance their utility while preserving data efficiency, recent research has increasingly focused on unsupervised adaptation methods that do not rely on labeled data. Despite the growing interest in this area, there remains a lack of a unified, task-oriented survey dedicated to unsupervised VLM adaptation. To bridge this gap, we present a comprehensive and structured overview of the field. We propose a taxonomy based on the availability and nature of unlabeled visual data, categorizing existing approaches into four key paradigms: Data-Free Transfer (no data), Unsupervised Domain Transfer (abundant data), Episodic Test-Time Adaptation (batch data), and Online Test-Time Adaptation (streaming data). Within this framework, we analyze core methodologies and adaptation strategies associated with each paradigm, aiming to establish a systematic understanding of the field. Additionally, we review representative benchmarks across diverse applications and highlight open challenges and promising directions for future research. An actively maintained repository of relevant literature is available at https://github.com/tim-learn/Awesome-LabelFree-VLMs.

📄 PDF Abstract BibTeX arXiv:2508.05547

Code (0)

등록된 구현이 없습니다.

Tasks

Test-time Adaptation

Similar Papers 제목 키워드 기반

Adapting Vision-Language Models from Iconic to Inclusive for Multi-Label Recognition Without Labels

2026-06-10 · Cheng Chen, Jingyu Zhou, Yifan Zhao, Jia Li arxiv

Understanding multi-label images remains a challenging task in computer vision. With the rapid progress of vision-language multimodal learning, vision-language models (VLMs) enable zero-shot recognition without labeled d…

Multi-Label Learning

CLIP-VG: Self-paced Curriculum Adapting of CLIP for Visual Grounding

2023-05-15 · Linhui Xiao, Xiaoshan Yang, Fang Peng, Ming Yan 외

Visual Grounding (VG) is a crucial topic in the field of vision and language, which involves locating a specific region described by expressions within an image. To reduce the reliance on manually labeled data, unsupervi…

DiversityTransfer LearningVisual Grounding

Adapting Contrastive Language-Image Pretrained (CLIP) Models for Out-of-Distribution Detection

2023-03-10 · Nikolas Adaloglou, Felix Michels, Tim Kaiser, Markus Kollmann

We present a comprehensive experimental study on pretrained feature extractors for visual out-of-distribution (OOD) detection, focusing on adapting contrastive language-image pretrained (CLIP) models. Without fine-tuning…

Anomaly DetectionImage CaptioningOut-of-Distribution DetectionOut of Distribution (OOD) Detection+1

Convolutional Visual Prompt for Robust Visual Perception

2023-03-01 · NeurIPS 2023 11

Vision models are often vulnerable to out-of-distribution (OOD) samples without adapting. While visual prompts offer a lightweight method of input-space adaptation for large-scale vision models, they rely on a high-dimen…

Test-time Adaptation

Bayesian-guided Label Mapping for Visual Reprogramming

2024-10-31 · Chengyi Cai, Zesheng Ye, Lei Feng, Jianzhong Qi 외

Visual reprogramming (VR) leverages the intrinsic capabilities of pretrained vision models by adapting their input or output interfaces to solve downstream tasks whose labels (i.e., downstream labels) might be totally di…