Spatio-thermal depth correction of RGB-D sensors based on Gaussian Processes in real-time
Commodity RGB-D sensors capture color images along with dense pixel-wise depth information in real-time. Typical RGB-D sensors are provided with a factory calibration and exhibit erratic depth readings due to coarse calibration values, ageing and thermal influence effects. This limits their applicability in computer vision and robotics. We propose a novel method to accurately calibrate depth considering spatial and thermal influences jointly. Our work is based on Gaussian Process Regression in a four dimensional Cartesian and thermal domain. We propose to leverage modern GPUs for dense depth map correction in real-time. For reproducibility we make our dataset and source code publicly available.
Code (1)
Tasks
Gaussian ProcessesregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Thermal odometry and dense mapping using learned odometry and Gaussian splatting
Thermal infrared sensors, with wavelengths longer than smoke particles, can capture imagery independent of darkness, dust, and smoke. This robustness has made them increasingly valuable for motion estimation and environm…
Image EnhancementMaking Thermal Imaging More Equitable and Accurate: Resolving Solar Loading Biases
Thermal cameras and thermal point detectors are used to measure the temperature of human skin. These are important devices that are used everyday in clinical and mass screening settings, particularly in an epidemic. Unfo…
Supercharging Thermal Gaussian Splatting with Depth Estimation
Efficient and robust 3D scene representation is crucial in autonomous driving, robotics, and related fields. While RGB images provide valuable content for 3D reconstruction, other modalities like thermal or depth can ena…
Novel View SynthesisAutonomous Driving3D ReconstructionDepth EstimationD$^2$GS: Dense Depth Regularization for LiDAR-free Urban Scene Reconstruction
Recently, Gaussian Splatting (GS) has shown great potential for urban scene reconstruction in the field of autonomous driving. However, current urban scene reconstruction methods often depend on multimodal sensors as inp…
Autonomous DrivingPoint CloudsMultisensor fusion-based digital twin in additive manufacturing for in-situ quality monitoring and defect correction
Early detection and correction of defects are critical in additive manufacturing (AM) to avoid build failures. In this paper, we present a multisensor fusion-based digital twin for in-situ quality monitoring and defect c…