paper-with-me

Papers

From Diffusion to Resolution: Leveraging 2D Diffusion Models for 3D Super-Resolution Task

2024-11-25 · BoHao Chen, Yanchao Zhang, Yanan Lv, Hua Han, Xi Chen

Diffusion models have recently emerged as a powerful technique in image generation, especially for image super-resolution tasks. While 2D diffusion models significantly enhance the resolution of individual images, existing diffusion-based methods for 3D volume super-resolution often struggle with structure discontinuities in axial direction and high sampling costs. In this work, we present a novel approach that leverages the 2D diffusion model and lateral continuity within the volume to enhance 3D volume electron microscopy (vEM) super-resolution. We first simulate lateral degradation with slices in the XY plane and train a 2D diffusion model to learn how to restore the degraded slices. The model is then applied slice-by-slice in the lateral direction of low-resolution volume, recovering slices while preserving inherent lateral continuity. Following this, a high-frequency-aware 3D super-resolution network is trained on the recovery lateral slice sequences to learn spatial feature transformation across slices. Finally, the network is applied to infer high-resolution volumes in the axial direction, enabling 3D super-resolution. We validate our approach through comprehensive evaluations, including image similarity assessments, resolution analysis, and performance on downstream tasks. Our results on two publicly available focused ion beam scanning electron microscopy (FIB-SEM) datasets demonstrate the robustness and practical applicability of our framework for 3D volume super-resolution.

📄 PDF Abstract BibTeX arXiv:2411.16792

Code (0)

등록된 구현이 없습니다.

Tasks

Image GenerationImage Super-ResolutionSuper-Resolution

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

SupResDiffGAN a new approach for the Super-Resolution task

2025-04-18 · Dawid Kopeć, Wojciech Kozłowski, Maciej Wizerkaniuk, Dawid Krutul 외

In this work, we present SupResDiffGAN, a novel hybrid architecture that combines the strengths of Generative Adversarial Networks (GANs) and diffusion models for super-resolution tasks. By leveraging latent space repres…

Image GenerationSuper-Resolution

CD-TVD: Contrastive Diffusion for 3D Super-Resolution with Scarce High-Resolution Time-Varying Data

2025-08-11 · Chongke Bi, Xin Gao, Jiangkang Deng, Guan Li 외 arxiv

Large-scale scientific simulations require significant resources to generate high-resolution time-varying data (TVD). While super-resolution is an efficient post-processing strategy to reduce costs, existing methods rely…

Contrastive LearningData Augmentation

Enhancing Weather Predictions: Super-Resolution via Deep Diffusion Models

2024-06-06 · Jan Martinů, Petr Šimánek

This study investigates the application of deep-learning diffusion models for the super-resolution of weather data, a novel approach aimed at enhancing the spatial resolution and detail of meteorological variables. Lever…

SSIMSuper-Resolution

Semantic Segmentation Prior for Diffusion-Based Real-World Super-Resolution

2024-12-04 · Jiahua Xiao, Jiawei Zhang, Dongqing Zou, Xiaodan Zhang 외

Real-world image super-resolution (Real-ISR) has achieved a remarkable leap by leveraging large-scale text-to-image models, enabling realistic image restoration from given recognition textual prompts. However, these meth…

Image RestorationImage Super-ResolutionSegmentationSemantic Segmentation+1

Composite Classifier-Free Guidance for Multi-Modal Conditioning in Wind Dynamics Super-Resolution

2025-12-13 · Jacob Schnell, Aditya Makkar, Gunadi Gani, Aniket Srinivasan Ashok 외 arxiv

Various weather modelling problems (e.g., weather forecasting, optimizing turbine placements, etc.) require ample access to high-resolution, highly accurate wind data. Acquiring such high-resolution wind data, however, r…

Image Super-ResolutionWeather Forecasting