Visual Tomography: Physically Faithful Volumetric Models of Partially Translucent Objects
When created faithfully from real-world data, Digital 3D representations of objects can be useful for human or computer-assisted analysis. Such models can also serve for generating training data for machine learning approaches in settings where data is difficult to obtain or where too few training data exists, e.g. by providing novel views or images in varying conditions. While the vast amount of visual 3D reconstruction approaches focus on non-physical models, textured object surfaces or shapes, in this contribution we propose a volumetric reconstruction approach that obtains a physical model including the interior of partially translucent objects such as plankton or insects. Our technique photographs the object under different poses in front of a bright white light source and computes absorption and scattering per voxel. It can be interpreted as visual tomography that we solve by inverse raytracing. We additionally suggest a method to convert non-physical NeRF media into a physically-based volumetric grid for initialization and illustrate the usefulness of the approach using two real-world plankton validation sets, the lab-scanned models being finally also relighted and virtually submerged in a scenario with augmented medium and illumination conditions. Please visit the project homepage at www.marine.informatik.uni-kiel.de/go/vito
Code (0)
등록된 구현이 없습니다.
Tasks
3D ReconstructionNeRFMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Volumetrically Consistent 3D Gaussian Rasterization
Recently, 3D Gaussian Splatting (3DGS) has enabled photorealistic view synthesis at high inference speeds. However, its splatting-based rendering model makes several approximations to the rendering equation, reducing phy…
3DGSSSIMRadGenome-Anatomy: A Large-Scale Anatomy-Labeled Chest Radiograph Dataset via Physically Grounded Volumetric Projection
Anatomical structure labels for chest radiographs are essential for medical image segmentation and a broad range of downstream diagnostic tasks. However, annotating anatomy directly on 2D chest radiographs is labor-inten…
Medical Image SegmentationBeyond Fourier transform: super-resolving optical coherence tomography
Optical coherence tomography (OCT) is a volumetric imaging modality that empowers clinicians and scientists to noninvasively visualize the cross-sections of biological samples. As the latest generation of its kind, Fouri…
Full Dynamic Range Sky-Modelling For Image Based Lighting
Accurate environment maps are a key component to modelling real-world outdoor scenes. They enable captivating visual arts, immersive virtual reality and a wide range of scientific and engineering applications. To allevia…
Data Stream Stabilization for Optical Coherence Tomography Volumetric Scanning
Optical Coherence Tomography (OCT) is an emerging medical imaging modality for luminal organ diagnosis. The non-constant rotation speed of optical components in the OCT catheter tip causes rotational distortion in OCT vo…