paper-with-me

홈 › Papers

A Practical Contrastive Learning Framework for Single-Image Super-Resolution

2021-11-27 · Gang Wu, Junjun Jiang, Xianming Liu

Contrastive learning has achieved remarkable success on various high-level tasks, but there are fewer contrastive learning-based methods proposed for low-level tasks. It is challenging to adopt vanilla contrastive learning technologies proposed for high-level visual tasks to low-level image restoration problems straightly. Because the acquired high-level global visual representations are insufficient for low-level tasks requiring rich texture and context information. In this paper, we investigate the contrastive learning-based single image super-resolution from two perspectives: positive and negative sample construction and feature embedding. The existing methods take naive sample construction approaches (e.g., considering the low-quality input as a negative sample and the ground truth as a positive sample) and adopt a prior model (e.g., pre-trained VGG model) to obtain the feature embedding. To this end, we propose a practical contrastive learning framework for SISR, named PCL-SR. We involve the generation of many informative positive and hard negative samples in frequency space. Instead of utilizing an additional pre-trained network, we design a simple but effective embedding network inherited from the discriminator network which is more task-friendly. Compared with existing benchmark methods, we re-train them by our proposed PCL-SR framework and achieve superior performance. Extensive experiments have been conducted to show the effectiveness and technical contributions of our proposed PCL-SR thorough ablation studies. The code and pre-trained models can be found at https://github.com/Aitical/PCL-SISR.

📄 PDF Abstract BibTeX arXiv:2111.13924

Code (1)

Aitical/PCL-SISR 공식 구현 pytorch

Tasks

Contrastive LearningImage RestorationImage Super-ResolutionSuper-Resolution

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

Towards Compact Single Image Super-Resolution via Contrastive Self-distillation

2021-05-25 · Yanbo Wang, Shaohui Lin, Yanyun Qu, Haiyan Wu 외

Convolutional neural networks (CNNs) are highly successful for super-resolution (SR) but often require sophisticated architectures with heavy memory cost and computational overhead, significantly restricts their practica…

Image Super-ResolutionSSIMSuper-ResolutionTransfer Learning

Self-Contrastive Learning: Single-viewed Supervised Contrastive Framework using Sub-network

2021-06-29 · Sangmin Bae, Sungnyun Kim, Jongwoo Ko, Gihun Lee 외

Contrastive loss has significantly improved performance in supervised classification tasks by using a multi-viewed framework that leverages augmentation and label information. The augmentation enables contrast with anoth…

Contrastive Learning

UniCLIP: Unified Framework for Contrastive Language-Image Pre-training

2022-09-27 · Janghyeon Lee, Jongsuk Kim, Hyounguk Shon, Bumsoo Kim 외

Pre-training vision-language models with contrastive objectives has shown promising results that are both scalable to large uncurated datasets and transferable to many downstream applications. Some following works have t…

Disc-Centric Contrastive Learning for Lumbar Spine Severity Grading

2026-02-05 · Sajjan Acharya, Pralisha Kansakar arxiv

This work examines a disc-centric approach for automated severity grading of lumbar spinal stenosis from sagittal T2-weighted MRI. The method combines contrastive pretraining with disc-level fine-tuning, using a single a…

Contrastive Learning

MaCo-GAN: Manifold-Contrastive Adversarial Learning for Single Image Super-Resolution

2026-06-03 · Daeyoung Han, Seongmin Hwang, Moongu Jeon arxiv

Conventional Generative Adversarial Networks (GANs) for Single Image Super-Resolution (SISR) often struggle with hallucinated artifacts, largely because standard discriminators evaluate overall image naturalness rather t…

Image Super-Resolution