paper-with-me

홈 › Papers

Spatial-Division Augmented Occupancy Field for Bone Shape Reconstruction from Biplanar X-Rays

2024-07-22 · Jixiang Chen, Yiqun Lin, Haoran Sun, Xiaomeng Li

Retrieving 3D bone anatomy from biplanar X-ray images is crucial since it can significantly reduce radiation exposure compared to traditional CT-based methods. Although various deep learning models have been proposed to address this complex task, they suffer from two limitations: 1) They employ voxel representation for bone shape and exploit 3D convolutional layers to capture anatomy prior, which are memory-intensive and limit the reconstruction resolution. 2) They overlook the prevalent occlusion effect within X-ray images and directly extract features using a simple loss, which struggles to fully exploit complex X-ray information. To tackle these concerns, we present Spatial-division Augmented Occupancy Field~(SdAOF). SdAOF adopts the continuous occupancy field for shape representation, reformulating the reconstruction problem as a per-point occupancy value prediction task. Its implicit and continuous nature enables memory-efficient training and fine-scale surface reconstruction at different resolutions during the inference. Moreover, we propose a novel spatial-division augmented distillation strategy to provide feature-level guidance for capturing the occlusion relationship. Extensive experiments on the pelvis reconstruction dataset show that SdAOF outperforms state-of-the-art methods and reconstructs fine-scale bone surfaces.The code is available at https://github.com/xmed-lab/SdAOF

📄 PDF Abstract BibTeX arXiv:2407.15433

Code (1)

xmed-lab/sdaof 공식 구현 pytorch

Tasks

AnatomySurface ReconstructionValue prediction

Similar Papers 제목 키워드 기반

PVP: Polar Representation Boost for 3D Semantic Occupancy Prediction

2024-12-10 · Yujing Xue, Jiaxiang Liu, Jiawei Du, Joey Tianyi Zhou

Recently, polar coordinate-based representations have shown promise for 3D perceptual tasks. Compared to Cartesian methods, polar grids provide a viable alternative, offering better detail preservation in nearby spaces w…

3D Semantic Occupancy Prediction

OctField: Hierarchical Implicit Functions for 3D Modeling

2021-11-01 · NeurIPS 2021 12 · Jia-Heng Tang, Weikai Chen, Jie Yang, Bo wang 외

Recent advances in localized implicit functions have enabled neural implicit representation to be scalable to large scenes. However, the regular subdivision of 3D space employed by these approaches fails to take into acc…

Accelerated Generative Models for 3D Point Cloud Data

2016-06-01 · CVPR 2016 6 · Benjamin Eckart, Kihwan Kim, Alejandro Troccoli, Alonzo Kelly 외

Finding meaningful, structured representations of 3D point cloud data (PCD) has become a core task for spatial perception applications. In this paper we introduce a method for constructing compact generative represent…

GPU

Robust 3D Semantic Occupancy Prediction with Calibration-free Spatial Transformation

2024-11-19 · Zhuangwei Zhuang, Ziyin Wang, Sitao Chen, Lizhao Liu 외

3D semantic occupancy prediction, which seeks to provide accurate and comprehensive representations of environment scenes, is important to autonomous driving systems. For autonomous cars equipped with multi-camera and Li…

3D Semantic Occupancy PredictionAutonomous Driving

DrivePI: Spatial-aware 4D MLLM for Unified Autonomous Driving Understanding, Perception, Prediction and Planning

2025-12-14 · Zhe Liu, Runhui Huang, Rui Yang, Siming Yan 외 arxiv

Although multi-modal large language models (MLLMs) have shown strong capabilities across diverse domains, their application in generating fine-grained 3D perception and prediction outputs in autonomous driving remains un…

Autonomous DrivingPoint Clouds