Coarse-Fine View Attention Alignment-Based GAN for CT Reconstruction from Biplanar X-Rays
For surgical planning and intra-operation imaging, CT reconstruction using X-ray images can potentially be an important alternative when CT imaging is not available or not feasible. In this paper, we aim to use biplanar X-rays to reconstruct a 3D CT image, because biplanar X-rays convey richer information than single-view X-rays and are more commonly used by surgeons. Different from previous studies in which the two X-ray views were treated indifferently when fusing the cross-view data, we propose a novel attention-informed coarse-to-fine cross-view fusion method to combine the features extracted from the orthogonal biplanar views. This method consists of a view attention alignment sub-module and a fine-distillation sub-module that are designed to work together to highlight the unique or complementary information from each of the views. Experiments have demonstrated the superiority of our proposed method over the SOTA methods.
Code (0)
등록된 구현이 없습니다.
Tasks
CT ReconstructionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
3D-C2FT: Coarse-to-fine Transformer for Multi-view 3D Reconstruction
Recently, the transformer model has been successfully employed for the multi-view 3D reconstruction problem. However, challenges remain on designing an attention mechanism to explore the multiview features and exploit th…
3D ReconstructionMulti-View 3D ReconstructionDynamic Gaussian Scene Reconstruction from Unsynchronized Videos
Multi-view video reconstruction plays a vital role in computer vision, enabling applications in film production, virtual reality, and motion analysis. While recent advances such as 4D Gaussian Splatting (4DGS) have demon…
Video ReconstructionNeuSurf: On-Surface Priors for Neural Surface Reconstruction from Sparse Input Views
Recently, neural implicit functions have demonstrated remarkable results in the field of multi-view reconstruction. However, most existing methods are tailored for dense views and exhibit unsatisfactory performance when …
Surface ReconstructionvalidPixel-Aligned Multi-View Generation with Depth Guided Decoder
The task of image-to-multi-view generation refers to generating novel views of an instance from a single image. Recent methods achieve this by extending text-to-image latent diffusion models to multi-view version, which …
3D ReconstructionDecoderDepth EstimationDust to Tower: Coarse-to-Fine Photo-Realistic Scene Reconstruction from Sparse Uncalibrated Images
Photo-realistic scene reconstruction from sparse-view, uncalibrated images is highly required in practice. Although some successes have been made, existing methods are either Sparse-View but require accurate camera param…
3DGSNovel View SynthesisPose Estimation