paper-with-me

홈 › Papers

Latent Space Super-Resolution for Higher-Resolution Image Generation with Diffusion Models

2025-03-24 · CVPR 2025 1 · Jinho Jeong, Sangmin Han, Jinwoo Kim, Seon Joo Kim

In this paper, we propose LSRNA, a novel framework for higher-resolution (exceeding 1K) image generation using diffusion models by leveraging super-resolution directly in the latent space. Existing diffusion models struggle with scaling beyond their training resolutions, often leading to structural distortions or content repetition. Reference-based methods address the issues by upsampling a low-resolution reference to guide higher-resolution generation. However, they face significant challenges: upsampling in latent space often causes manifold deviation, which degrades output quality. On the other hand, upsampling in RGB space tends to produce overly smoothed outputs. To overcome these limitations, LSRNA combines Latent space Super-Resolution (LSR) for manifold alignment and Region-wise Noise Addition (RNA) to enhance high-frequency details. Our extensive experiments demonstrate that integrating LSRNA outperforms state-of-the-art reference-based methods across various resolutions and metrics, while showing the critical role of latent space upsampling in preserving detail and sharpness. The code is available at https://github.com/3587jjh/LSRNA.

📄 PDF Abstract BibTeX arXiv:2503.18446

Code (1)

3587jjh/lsrna 공식 구현 pytorch

Tasks

Image GenerationSuper-Resolution

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Space-Time-Aware Multi-Resolution Video Enhancement

2020-03-30 · CVPR 2020 6 · Muhammad Haris, Greg Shakhnarovich, Norimichi Ukita

We consider the problem of space-time super-resolution (ST-SR): increasing spatial resolution of video frames and simultaneously interpolating frames to increase the frame rate. Modern approaches handle these axes one at…

Super-ResolutionVideo EnhancementVideo Super-Resolution

A Latent Encoder Coupled Generative Adversarial Network (LE-GAN) for Efficient Hyperspectral Image Super-resolution

2021-11-16 · Yue Shi, Liangxiu Han, Lianghao Han, Sheng Chang 외

Realistic hyperspectral image (HSI) super-resolution (SR) techniques aim to generate a high-resolution (HR) HSI with higher spectral and spatial fidelity from its low-resolution (LR) counterpart. The generative adversari…

Generative Adversarial NetworkHyperspectral Image Super-ResolutionImage Super-ResolutionSuper-Resolution

PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models

2020-03-08 · CVPR 2020 6 · Sachit Menon, Alexandru Damian, Shijia Hu, Nikhil Ravi 외

The primary aim of single-image super-resolution is to construct high-resolution (HR) images from corresponding low-resolution (LR) inputs. In previous approaches, which have generally been supervised, the training objec…

Face HallucinationHallucinationImage Super-ResolutionSuper-Resolution

Latent Convolutional Models

2018-06-16 · ICLR 2019 5 · ShahRukh Athar, Evgeny Burnaev, Victor Lempitsky

We present a new latent model of natural images that can be learned on large-scale datasets. The learning process provides a latent embedding for every image in the training dataset, as well as a deep convolutional netwo…

ColorizationImage Restoration

Soft-IntroVAE for Continuous Latent space Image Super-Resolution

2023-07-18 · Zhi-Song Liu, Zijia Wang, Zhen Jia

Continuous image super-resolution (SR) recently receives a lot of attention from researchers, for its practical and flexible image scaling for various displays. Local implicit image representation is one of the methods t…

DenoisingImage RestorationImage Super-ResolutionSuper-Resolution