paper-with-me

Papers

Benchmarking Encoder-Decoder Architectures for Biplanar X-ray to 3D Shape Reconstruction

2023-09-24 · Mahesh Shakya, Bishesh Khanal

Various deep learning models have been proposed for 3D bone shape reconstruction from two orthogonal (biplanar) X-ray images. However, it is unclear how these models compare against each other since they are evaluated on different anatomy, cohort and (often privately held) datasets. Moreover, the impact of the commonly optimized image-based segmentation metrics such as dice score on the estimation of clinical parameters relevant in 2D-3D bone shape reconstruction is not well known. To move closer toward clinical translation, we propose a benchmarking framework that evaluates tasks relevant to real-world clinical scenarios, including reconstruction of fractured bones, bones with implants, robustness to population shift, and error in estimating clinical parameters. Our open-source platform provides reference implementations of 8 models (many of whose implementations were not publicly available), APIs to easily collect and preprocess 6 public datasets, and the implementation of automatic clinical parameter and landmark extraction methods. We present an extensive evaluation of 8 2D-3D models on equal footing using 6 public datasets comprising images for four different anatomies. Our results show that attention-based methods that capture global spatial relationships tend to perform better across all anatomies and datasets; performance on clinically relevant subgroups may be overestimated without disaggregated reporting; ribs are substantially more difficult to reconstruct compared to femur, hip and spine; and the dice score improvement does not always bring a corresponding improvement in the automatic estimation of clinically relevant parameters.

📄 PDF Abstract BibTeX arXiv:2309.13587

Code (1)

naamiinepal/xrayto3d-benchmark pytorch

Tasks

3D Shape ReconstructionAnatomyBenchmarkingDecoder

Similar Papers 제목 키워드 기반

Benchmarking Encoder-Decoder Architectures for Biplanar X-ray to 3D Bone Shape Reconstruction

2023-09-26 · NeurIPS 2023 11

Various deep learning models have been proposed for 3D bone shape reconstruction from two orthogonal (biplanar) X-ray images. However, it is unclear how these models compare against each other since they are evaluated on…

Swin-X2S: Reconstructing 3D Shape from 2D Biplanar X-ray with Swin Transformers

2025-01-10 · Kuan Liu, Zongyuan Ying, Jie Jin, Dongyan Li 외

The conversion from 2D X-ray to 3D shape holds significant potential for improving diagnostic efficiency and safety. However, existing reconstruction methods often rely on hand-crafted features, manual intervention, and …

DecoderDiagnostic

UCLID-Net: Single View Reconstruction in Object Space

2020-06-06 · NeurIPS 2020 12 · Benoit Guillard, Edoardo Remelli, Pascal Fua

Most state-of-the-art deep geometric learning single-view reconstruction approaches rely on encoder-decoder architectures that output either shape parametrizations or implicit representations. However, these representati…

BenchmarkingDecoderObject

SPIDER: Structure-Preferential Implicit Deep Network for Biplanar X-ray Reconstruction

2025-07-07 · Tianqi Yu, Xuanyu Tian, Jiawen Yang, Dongming He 외 arxiv

Biplanar X-ray imaging is widely used in health screening, postoperative rehabilitation evaluation of orthopedic diseases, and injury surgery due to its rapid acquisition, low radiation dose, and straightforward setup. H…

Frame Averaging for Equivariant Shape Space Learning

2021-12-03 · CVPR 2022 1 · Matan Atzmon, Koki Nagano, Sanja Fidler, Sameh Khamis 외

The task of shape space learning involves mapping a train set of shapes to and from a latent representation space with good generalization properties. Often, real-world collections of shapes have symmetries, which can be…