paper-with-me

Papers

DiffuseIR:Diffusion Models For Isotropic Reconstruction of 3D Microscopic Images

2023-06-21 · Mingjie Pan, Yulu Gan, Fangxu Zhou, Jiaming Liu, Aimin Wang, Shanghang Zhang, Dawei Li

Three-dimensional microscopy is often limited by anisotropic spatial resolution, resulting in lower axial resolution than lateral resolution. Current State-of-The-Art (SoTA) isotropic reconstruction methods utilizing deep neural networks can achieve impressive super-resolution performance in fixed imaging settings. However, their generality in practical use is limited by degraded performance caused by artifacts and blurring when facing unseen anisotropic factors. To address these issues, we propose DiffuseIR, an unsupervised method for isotropic reconstruction based on diffusion models. First, we pre-train a diffusion model to learn the structural distribution of biological tissue from lateral microscopic images, resulting in generating naturally high-resolution images. Then we use low-axial-resolution microscopy images to condition the generation process of the diffusion model and generate high-axial-resolution reconstruction results. Since the diffusion model learns the universal structural distribution of biological tissues, which is independent of the axial resolution, DiffuseIR can reconstruct authentic images with unseen low-axial resolutions into a high-axial resolution without requiring re-training. The proposed DiffuseIR achieves SoTA performance in experiments on EM data and can even compete with supervised methods.

📄 PDF Abstract BibTeX arXiv:2306.12109

Code (0)

등록된 구현이 없습니다.

Tasks

Super-Resolution

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Diffusion-driven lensless fiber endomicroscopic quantitative phase imaging towards digital pathology

2024-07-26 · Zhaoqing Chen, Jiawei Sun, Xibin Yang, Xinyi Ye 외

Lensless fiber endomicroscope is an emerging tool for in-vivo microscopic imaging, where quantitative phase imaging (QPI) can be utilized as a label-free method to enhance image contrast. However, existing single-shot ph…

AttributeCell SegmentationDenoising

GRED: Graph-Regularized 3D Shape Reconstruction from Highly Anisotropic and Noisy Images

2013-09-17 · Christian Widmer, Philipp Drewe, Xinghua Lou, Shefali Umrania 외

Analysis of microscopy images can provide insight into many biological processes. One particularly challenging problem is cell nuclear segmentation in highly anisotropic and noisy 3D image data. Manually localizing and s…

3D Shape ReconstructionBIG-bench Machine LearningNuclear SegmentationSegmentation

Reference-free Axial Super-resolution of 3D Microscopy Images using Implicit Neural Representation with a 2D Diffusion Prior

2024-08-16 · Kyungryun Lee, Won-Ki Jeong

Analysis and visualization of 3D microscopy images pose challenges due to anisotropic axial resolution, demanding volumetric super-resolution along the axial direction. While training a learning-based 3D super-resolution…

Super-Resolution

Reference-Free Isotropic 3D EM Reconstruction using Diffusion Models

2023-08-03 · Kyungryun Lee, Won-Ki Jeong

Electron microscopy (EM) images exhibit anisotropic axial resolution due to the characteristics inherent to the imaging modality, presenting challenges in analysis and downstream tasks.In this paper, we propose a diffusi…

Recursive Training of 2D-3D Convolutional Networks for Neuronal Boundary Detection

2015-08-20 · NeurIPS 2015 · Kisuk Lee, Aleksandar Zlateski, Ashwin Vishwanathan, H. Sebastian Seung

Efforts to automate the reconstruction of neural circuits from 3D electron microscopic (EM) brain images are critical for the field of connectomics. An important computation for reconstruction is the detection of neurona…

3D ArchitectureBoundary DetectionCPU