paper-with-me

홈 › Papers

CuNeRF: Cube-Based Neural Radiance Field for Zero-Shot Medical Image Arbitrary-Scale Super Resolution

2023-03-28 · ICCV 2023 1 · Zixuan Chen, Jian-Huang Lai, Lingxiao Yang, Xiaohua Xie

Medical image arbitrary-scale super-resolution (MIASSR) has recently gained widespread attention, aiming to super sample medical volumes at arbitrary scales via a single model. However, existing MIASSR methods face two major limitations: (i) reliance on high-resolution (HR) volumes and (ii) limited generalization ability, which restricts their application in various scenarios. To overcome these limitations, we propose Cube-based Neural Radiance Field (CuNeRF), a zero-shot MIASSR framework that can yield medical images at arbitrary scales and viewpoints in a continuous domain. Unlike existing MIASSR methods that fit the mapping between low-resolution (LR) and HR volumes, CuNeRF focuses on building a coordinate-intensity continuous representation from LR volumes without the need for HR references. This is achieved by the proposed differentiable modules: including cube-based sampling, isotropic volume rendering, and cube-based hierarchical rendering. Through extensive experiments on magnetic resource imaging (MRI) and computed tomography (CT) modalities, we demonstrate that CuNeRF outperforms state-of-the-art MIASSR methods. CuNeRF yields better visual verisimilitude and reduces aliasing artifacts at various upsampling factors. Moreover, our CuNeRF does not need any LR-HR training pairs, which is more flexible and easier to be used than others. Our code is released at https://github.com/NarcissusEx/CuNeRF.

📄 PDF Abstract BibTeX arXiv:2303.16242

Code (1)

NarcissusEx/CuNeRF 공식 구현 pytorch

Tasks

Computed Tomography (CT)Super-Resolution

Similar Papers 제목 키워드 기반

StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fields

2023-03-19 · CVPR 2023 1 · Kunhao Liu, Fangneng Zhan, YiWen Chen, Jiahui Zhang 외

3D style transfer aims to render stylized novel views of a 3D scene with multi-view consistency. However, most existing work suffers from a three-way dilemma over accurate geometry reconstruction, high-quality stylizatio…

Style Transfer

ZIGNeRF: Zero-shot 3D Scene Representation with Invertible Generative Neural Radiance Fields

2023-06-05 · Kanghyeok Ko, Minhyeok Lee

Generative Neural Radiance Fields (NeRFs) have demonstrated remarkable proficiency in synthesizing multi-view images by learning the distribution of a set of unposed images. Despite the aptitude of existing generative Ne…

Generative Adversarial Network

OmniGS: Fast Radiance Field Reconstruction using Omnidirectional Gaussian Splatting

2024-04-04 · Longwei Li, Huajian Huang, Sai-Kit Yeung, Hui Cheng

Photorealistic reconstruction relying on 3D Gaussian Splatting has shown promising potential in various domains. However, the current 3D Gaussian Splatting system only supports radiance field reconstruction using undisto…

GPU

GaussianCube: A Structured and Explicit Radiance Representation for 3D Generative Modeling

2024-03-28 · BoWen Zhang, Yiji Cheng, Jiaolong Yang, Chunyu Wang 외

We introduce a radiance representation that is both structured and fully explicit and thus greatly facilitates 3D generative modeling. Existing radiance representations either require an implicit feature decoder, which s…

DecoderText to 3D

LaRa: Efficient Large-Baseline Radiance Fields

2024-07-05 · Anpei Chen, Haofei Xu, Stefano Esposito, Siyu Tang 외

Radiance field methods have achieved photorealistic novel view synthesis and geometry reconstruction. But they are mostly applied in per-scene optimization or small-baseline settings. While several recent works investiga…

3D ReconstructionNovel View Synthesis