Self-Supervised Adaptation for Video Super-Resolution
Recent single-image super-resolution (SISR) networks, which can adapt their network parameters to specific input images, have shown promising results by exploiting the information available within the input data as well as large external datasets. However, the extension of these self-supervised SISR approaches to video handling has yet to be studied. Thus, we present a new learning algorithm that allows conventional video super-resolution (VSR) networks to adapt their parameters to test video frames without using the ground-truth datasets. By utilizing many self-similar patches across space and time, we improve the performance of fully pre-trained VSR networks and produce temporally consistent video frames. Moreover, we present a test-time knowledge distillation technique that accelerates the adaptation speed with less hardware resources. In our experiments, we demonstrate that our novel learning algorithm can fine-tune state-of-the-art VSR networks and substantially elevate performance on numerous benchmark datasets.
Code (1)
Tasks
Image Super-ResolutionKnowledge DistillationSuper-ResolutionVideo Super-ResolutionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Unsupervised Video Domain Adaptation with Masked Pre-Training and Collaborative Self-Training
In this work, we tackle the problem of unsupervised domain adaptation (UDA) for video action recognition. Our approach, which we call UNITE, uses an image teacher model to adapt a video student model to the target domain…
Action RecognitionDomain AdaptationTemporal Action LocalizationUnsupervised Domain AdaptationLearning Spatial Adaptation and Temporal Coherence in Diffusion Models for Video Super-Resolution
Diffusion models are just at a tipping point for image super-resolution task. Nevertheless, it is not trivial to capitalize on diffusion models for video super-resolution which necessitates not only the preservation of v…
DecoderDenoisingImage Super-ResolutionSuper-Resolution+3VESSA: Video-based objEct-centric Self-Supervised Adaptation for Visual Foundation Models
Foundation models have advanced computer vision by enabling strong performance across diverse tasks through large-scale pretraining and supervised fine-tuning. However, they may underperform in domains with distribution …
Self-Supervised LearningSelf-supervised ControlNet with Spatio-Temporal Mamba for Real-world Video Super-resolution
Existing diffusion-based video super-resolution (VSR) methods are susceptible to introducing complex degradations and noticeable artifacts into high-resolution videos due to their inherent randomness. In this paper, …
Contrastive LearningMambaSelf-Supervised LearningSuper-Resolution+1VILLS -- Video-Image Learning to Learn Semantics for Person Re-Identification
Person Re-identification is a research area with significant real world applications. Despite recent progress, existing methods face challenges in robust re-identification in the wild, e.g., by focusing only on a particu…
Interactive SegmentationPerson Re-IdentificationSelf-Supervised Learning