paper-with-me

홈 › Papers

Learning to Distill Global Representation for Sparse-View CT

2023-08-16 · ICCV 2023 1 · Zilong Li, Chenglong Ma, Jie Chen, Junping Zhang, Hongming Shan

Sparse-view computed tomography (CT) -- using a small number of projections for tomographic reconstruction -- enables much lower radiation dose to patients and accelerated data acquisition. The reconstructed images, however, suffer from strong artifacts, greatly limiting their diagnostic value. Current trends for sparse-view CT turn to the raw data for better information recovery. The resultant dual-domain methods, nonetheless, suffer from secondary artifacts, especially in ultra-sparse view scenarios, and their generalization to other scanners/protocols is greatly limited. A crucial question arises: have the image post-processing methods reached the limit? Our answer is not yet. In this paper, we stick to image post-processing methods due to great flexibility and propose global representation (GloRe) distillation framework for sparse-view CT, termed GloReDi. First, we propose to learn GloRe with Fourier convolution, so each element in GloRe has an image-wide receptive field. Second, unlike methods that only use the full-view images for supervision, we propose to distill GloRe from intermediate-view reconstructed images that are readily available but not explored in previous literature. The success of GloRe distillation is attributed to two key components: representation directional distillation to align the GloRe directions, and band-pass-specific contrastive distillation to gain clinically important details. Extensive experiments demonstrate the superiority of the proposed GloReDi over the state-of-the-art methods, including dual-domain ones. The source code is available at https://github.com/longzilicart/GloReDi.

📄 PDF Abstract BibTeX arXiv:2308.08463

Code (1)

longzilicart/gloredi 공식 구현 pytorch

Tasks

Computed Tomography (CT)Diagnostic

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

CVSD-Reg: Cross-Modal Visual Semantic Prior Distillation for Robust LiDAR Registration

2026-08-20 · Eunsoo Im, Junghun Suh, Gyeonggwan Lee, Seunghwan Hong arxiv

Learning-based global point cloud registration has achieved remarkable progress, yet its reliance on geometric representations makes existing methods sensitive to variations in point density, scan pattern, viewpoint, and…

Point Cloud Registration

Sparse3D: Distilling Multiview-Consistent Diffusion for Object Reconstruction from Sparse Views

2023-08-27 · Zi-Xin Zou, Weihao Cheng, Yan-Pei Cao, Shi-Sheng Huang 외

Reconstructing 3D objects from extremely sparse views is a long-standing and challenging problem. While recent techniques employ image diffusion models for generating plausible images at novel viewpoints or for distillin…

3D ReconstructionNovel View SynthesisObject Reconstruction

NEAT: Distilling 3D Wireframes from Neural Attraction Fields

2023-07-14 · CVPR 2024 1 · Nan Xue, Bin Tan, Yuxi Xiao, Liang Dong 외

This paper studies the problem of structured 3D reconstruction using wireframes that consist of line segments and junctions, focusing on the computation of structured boundary geometries of scenes. Instead of leveraging …

3D Reconstruction3D Wireframe ReconstructionNovel View Synthesis

SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstruction

2022-12-01 · CVPR 2023 1 · Zhizhuo Zhou, Shubham Tulsiani

We propose SparseFusion, a sparse view 3D reconstruction approach that unifies recent advances in neural rendering and probabilistic image generation. Existing approaches typically build on neural rendering with re-proje…

3D ReconstructionImage GenerationNeural RenderingNovel View Synthesis

DistillNeRF: Perceiving 3D Scenes from Single-Glance Images by Distilling Neural Fields and Foundation Model Features

2024-06-17 · Letian Wang, Seung Wook Kim, Jiawei Yang, Cunjun Yu 외

We propose DistillNeRF, a self-supervised learning framework addressing the challenge of understanding 3D environments from limited 2D observations in outdoor autonomous driving scenes. Our method is a generalizable feed…

3D geometry3D Semantic Occupancy PredictionAutonomous DrivingDepth Estimation+3