paper-with-me

Papers

VL-UR: Vision-Language-guided Universal Restoration of Images Degraded by Adverse Weather Conditions

2025-04-11 · Ziyan Liu, Yuxu Lu, Huashan Yu, Dong Yang

Image restoration is critical for improving the quality of degraded images, which is vital for applications like autonomous driving, security surveillance, and digital content enhancement. However, existing methods are often tailored to specific degradation scenarios, limiting their adaptability to the diverse and complex challenges in real-world environments. Moreover, real-world degradations are typically non-uniform, highlighting the need for adaptive and intelligent solutions. To address these issues, we propose a novel vision-language-guided universal restoration (VL-UR) framework. VL-UR leverages a zero-shot contrastive language-image pre-training (CLIP) model to enhance image restoration by integrating visual and semantic information. A scene classifier is introduced to adapt CLIP, generating high-quality language embeddings aligned with degraded images while predicting degraded types for complex scenarios. Extensive experiments across eleven diverse degradation settings demonstrate VL-UR's state-of-the-art performance, robustness, and adaptability. This positions VL-UR as a transformative solution for modern image restoration challenges in dynamic, real-world environments.

📄 PDF Abstract BibTeX arXiv:2504.08219

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingImage Restoration

Methods 이 논문이 사용한 방법론

CLIP Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning…

Similar Papers 제목 키워드 기반

Vision-Language Model Guided Image Restoration

2025-12-19 · Cuixin Yang, Rongkang Dong, Kin-Man Lam arxiv

Many image restoration (IR) tasks require both pixel-level fidelity and high-level semantic understanding to recover realistic photos with fine-grained details. However, previous approaches often struggle to effectively …

Image Restoration

PromptHSI: Universal Hyperspectral Image Restoration with Vision-Language Modulated Frequency Adaptation

2024-11-24 · Chia-Ming Lee, Ching-Heng Cheng, Yu-Fan Lin, Yi-Ching Cheng 외

Recent advances in All-in-One (AiO) RGB image restoration have demonstrated the effectiveness of prompt learning in handling multiple degradations within a single model. However, extending these approaches to hyperspectr…

Image RestorationLanguage ModelingLanguage ModellingPrompt Learning

LLMRA: Multi-modal Large Language Model based Restoration Assistant

2024-01-21 · Xiaoyu Jin, Yuan Shi, Bin Xia, Wenming Yang

Multi-modal Large Language Models (MLLMs) have a significant impact on various tasks, due to their extensive knowledge and powerful perception and generation capabilities. However, it still remains an open research probl…

Image RestorationLanguage ModelingLanguage ModellingLarge Language Model

Diff-Restorer: Unleashing Visual Prompts for Diffusion-based Universal Image Restoration

2024-07-04 · Yuhong Zhang, Hengsheng Zhang, Xinning Chai, Zhengxue Cheng 외

Image restoration is a classic low-level problem aimed at recovering high-quality images from low-quality images with various degradations such as blur, noise, rain, haze, etc. However, due to the inherent complexity and…

DecoderImage RestorationLanguage Modelling

ProRes: Exploring Degradation-aware Visual Prompt for Universal Image Restoration

2023-06-23 · Jiaqi Ma, Tianheng Cheng, Guoli Wang, Qian Zhang 외

Image restoration aims to reconstruct degraded images, e.g., denoising or deblurring. Existing works focus on designing task-specific methods and there are inadequate attempts at universal methods. However, simply unifyi…

DeblurringDenoisingImage RestorationLow-Light Image Enhancement+3