paper-with-me

홈 › Papers

Scale-Equivariant Imaging: Self-Supervised Learning for Image Super-Resolution and Deblurring

2023-12-18 · Jérémy Scanvic, Mike Davies, Patrice Abry, Julián Tachella

Self-supervised methods have recently proved to be nearly as effective as supervised ones in various imaging inverse problems, paving the way for learning-based approaches in scientific and medical imaging applications where ground truth data is hard or expensive to obtain. These methods critically rely on invariance to translations and/or rotations of the image distribution to learn from incomplete measurement data alone. However, existing approaches fail to obtain competitive performances in the problems of image super-resolution and deblurring, which play a key role in most imaging systems. In this work, we show that invariance to roto-translations is insufficient to learn from measurements that only contain low-frequency information. Instead, we propose scale-equivariant imaging, a new self-supervised approach that leverages the fact that many image distributions are approximately scale-invariant, enabling the recovery of high-frequency information lost in the measurement process. We demonstrate throughout a series of experiments on real datasets that the proposed method outperforms other self-supervised approaches, and obtains performances on par with fully supervised learning.

📄 PDF Abstract BibTeX arXiv:2312.11232

Code (1)

jscanvic/scale-equivariant-imaging 공식 구현 pytorch

Tasks

DeblurringImage Super-ResolutionSelf-Supervised LearningSuper-Resolution

Similar Papers 제목 키워드 기반

Hyperspectral Diffusion Equivariant Imaging (HyDiff-EI): A Self-supervised Framework for Hyperspectral Image Inpainting

2026-08-27 · Shuo Li, Mike Davies, Mehrdad Yaghoobi arxiv

A novel Hyperspectral diffusion Equivariant Imaging (HyDiff-EI) framework for solving the hyperspectral image (HSI) inpainting problem has been presented here. Unlike conventional diffusion-based methods that rely on lar…

Image Inpainting

Imaging with Equivariant Deep Learning

2022-09-05 · Dongdong Chen, Mike Davies, Matthias J. Ehrhardt, Carola-Bibiane Schönlieb 외

From early image processing to modern computational imaging, successful models and algorithms have relied on a fundamental property of natural signals: symmetry. Here symmetry refers to the invariance property of signal …

compressed sensingDeep Learningimage-classificationImage Classification+1

Robust Equivariant Imaging: a fully unsupervised framework for learning to image from noisy and partial measurements

2021-11-25 · CVPR 2022 1 · Dongdong Chen, Julián Tachella, Mike E. Davies

Deep networks provide state-of-the-art performance in multiple imaging inverse problems ranging from medical imaging to computational photography. However, most existing networks are trained with clean signals which are …

Self-Supervised Learning

Nonlinear Equivariant Imaging: Learning Multi-Parametric Tissue Mapping without Ground Truth for Compressive Quantitative MRI

2022-11-23 · Ketan Fatania, Kwai Y. Chau, Carolin M. Pirkl, Marion I. Menzel 외

Current state-of-the-art reconstruction for quantitative tissue maps from fast, compressive, Magnetic Resonance Fingerprinting (MRF), use supervised deep learning, with the drawback of requiring high-fidelity ground trut…

Image ReconstructionMagnetic Resonance FingerprintingQuantitative MRISelf-Supervised Learning

Equivariant Multi-Modality Image Fusion

2023-05-19 · CVPR 2024 1 · Zixiang Zhao, Haowen Bai, Jiangshe Zhang, Yulun Zhang 외

Multi-modality image fusion is a technique that combines information from different sensors or modalities, enabling the fused image to retain complementary features from each modality, such as functional highlights and t…

Self-Supervised Learning