VL-UR: Vision-Language-guided Universal Restoration of Images Degraded by Adverse Weather Conditions
Image restoration is critical for improving the quality of degraded images, which is vital for applications like autonomous driving, security surveillance, and digital content enhancement. However, existing methods are often tailored to specific degradation scenarios, limiting their adaptability to the diverse and complex challenges in real-world environments. Moreover, real-world degradations are typically non-uniform, highlighting the need for adaptive and intelligent solutions. To address these issues, we propose a novel vision-language-guided universal restoration (VL-UR) framework. VL-UR leverages a zero-shot contrastive language-image pre-training (CLIP) model to enhance image restoration by integrating visual and semantic information. A scene classifier is introduced to adapt CLIP, generating high-quality language embeddings aligned with degraded images while predicting degraded types for complex scenarios. Extensive experiments across eleven diverse degradation settings demonstrate VL-UR's state-of-the-art performance, robustness, and adaptability. This positions VL-UR as a transformative solution for modern image restoration challenges in dynamic, real-world environments.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingImage RestorationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Vision-Language Model Guided Image Restoration
Many image restoration (IR) tasks require both pixel-level fidelity and high-level semantic understanding to recover realistic photos with fine-grained details. However, previous approaches often struggle to effectively …
Image RestorationPromptHSI: Universal Hyperspectral Image Restoration with Vision-Language Modulated Frequency Adaptation
Recent advances in All-in-One (AiO) RGB image restoration have demonstrated the effectiveness of prompt learning in handling multiple degradations within a single model. However, extending these approaches to hyperspectr…
Image RestorationLanguage ModelingLanguage ModellingPrompt LearningLLMRA: Multi-modal Large Language Model based Restoration Assistant
Multi-modal Large Language Models (MLLMs) have a significant impact on various tasks, due to their extensive knowledge and powerful perception and generation capabilities. However, it still remains an open research probl…
Image RestorationLanguage ModelingLanguage ModellingLarge Language ModelDiff-Restorer: Unleashing Visual Prompts for Diffusion-based Universal Image Restoration
Image restoration is a classic low-level problem aimed at recovering high-quality images from low-quality images with various degradations such as blur, noise, rain, haze, etc. However, due to the inherent complexity and…
DecoderImage RestorationLanguage ModellingProRes: Exploring Degradation-aware Visual Prompt for Universal Image Restoration
Image restoration aims to reconstruct degraded images, e.g., denoising or deblurring. Existing works focus on designing task-specific methods and there are inadequate attempts at universal methods. However, simply unifyi…
DeblurringDenoisingImage RestorationLow-Light Image Enhancement+3