paper-with-me

홈 › Papers

CLIP-aware Domain-Adaptive Super-Resolution

2025-05-18 · Zhengyang Lu, Qian Xia, Weifan Wang, Feng Wang

This work introduces CLIP-aware Domain-Adaptive Super-Resolution (CDASR), a novel framework that addresses the critical challenge of domain generalization in single image super-resolution. By leveraging the semantic capabilities of CLIP (Contrastive Language-Image Pre-training), CDASR achieves unprecedented performance across diverse domains and extreme scaling factors. The proposed method integrates CLIP-guided feature alignment mechanism with a meta-learning inspired few-shot adaptation strategy, enabling efficient knowledge transfer and rapid adaptation to target domains. A custom domain-adaptive module processes CLIP features alongside super-resolution features through a multi-stage transformation process, including CLIP feature processing, spatial feature generation, and feature fusion. This intricate process ensures effective incorporation of semantic information into the super-resolution pipeline. Additionally, CDASR employs a multi-component loss function that combines pixel-wise reconstruction, perceptual similarity, and semantic consistency. Extensive experiments on benchmark datasets demonstrate CDASR's superiority, particularly in challenging scenarios. On the Urban100 dataset at $\times$8 scaling, CDASR achieves a significant PSNR gain of 0.15dB over existing methods, with even larger improvements of up to 0.30dB observed at $\times$16 scaling.

📄 PDF Abstract BibTeX arXiv:2505.12391

Code (0)

등록된 구현이 없습니다.

Tasks

Domain GeneralizationImage Super-ResolutionMeta-LearningSuper-ResolutionTransfer Learning

Methods 이 논문이 사용한 방법론

CLIP Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning…

Similar Papers 제목 키워드 기반

CLIPPan: Adapting CLIP as A Supervisor for Unsupervised Pansharpening

2025-11-14 · Lihua Jian, Jiabo Liu, Shaowu Wu, Lihui Chen arxiv

Despite remarkable advancements in supervised pansharpening neural networks, these methods face domain adaptation challenges of resolution due to the intrinsic disparity between simulated reduced-resolution training data…

Domain Adaptation

WAVECLIP: Wavelet Tokenization for Adaptive-Resolution CLIP

2025-09-25 · Moshe Kimhi, Erez Koifman, Ehud Rivlin, Eli Schwartz 외 arxiv

We introduce WAVECLIP, a single unified model for adaptive resolution inference in CLIP, enabled by wavelet-based tokenization. WAVECLIP replaces standard patch embeddings with a multi-level wavelet decomposition, enabli…

AFANet: Adaptive Frequency-Aware Network for Weakly-Supervised Few-Shot Semantic Segmentation

2024-12-23 · Jiaqi Ma, Guo-Sen Xie, Fang Zhao, Zechao Li

Few-shot learning aims to recognize novel concepts by leveraging prior knowledge learned from a few samples. However, for visually intensive tasks such as few-shot semantic segmentation, pixel-level annotations are time-…

Few-Shot LearningFew-Shot Semantic SegmentationNovel ConceptsSemantic Segmentation

Real-Time LiDAR Super-Resolution via Frequency-Aware Multi-Scale Fusion

2025-11-10 · June Moh Goo, Zichao Zeng, Jan Boehm arxiv

LiDAR super-resolution addresses the challenge of achieving high-quality 3D perception from cost-effective, low-resolution sensors. While recent transformer-based approaches like TULIP show promise, they remain limited t…

Mixture of Ranks with Degradation-Aware Routing for One-Step Real-World Image Super-Resolution

2025-11-20 · Xiao He, Zhijun Tu, Kun Cheng, Mingrui Zhu 외 arxiv

The demonstrated success of sparsely-gated Mixture-of-Experts (MoE) architectures, exemplified by models such as DeepSeek and Grok, has motivated researchers to investigate their adaptation to diverse domains. In real-wo…

Image Super-Resolution