Modeling the Effects of Windshield Refraction for Camera Calibration
In this paper, we study the effects of windshield refraction for autonomous driving applications. These distortion effects are surprisingly large and can not be explained by traditional camera models. Instead of using a generalized camera approach, we propose a novel approach to jointly optimize a traditional camera model, and a mathematical representation of the windshield’s surface. First, using the laws of geometric optics, the refraction is modeled using a local spherical approximation to the windshield’s geometry. Next, a spline-based model is proposed as a refinement to better adapt to deviations from the ideal shape and manufacturing variations. By jointly optimizing refraction and camera parameters, the projection error can be significantly reduced. The proposed models are validated on real windshield observations and custom setups to compare recordings with and without windshield, with accurate laser scan measurements as 3D ground truth.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingCamera CalibrationSimilar Papers 제목 키워드 기반
Refractive Geometry for Underwater Domes
Underwater cameras are typically placed behind glass windows to protect them from the water. Spherical glass, a dome port, is well suited for high water pressures at great depth, allows for a large field of view, and avo…
Underwater Camera Calibration Using Wavelength Triangulation
In underwater imagery, the image formation process includes refractions that occur when light passes from water into the camera housing, typically through a flat glass port. We extend the existing work on physical refrac…
Camera CalibrationREF$^2$-NeRF: Reflection and Refraction aware Neural Radiance Field
Recently, significant progress has been made in the study of methods for 3D reconstruction from multiple images using implicit neural representations, exemplified by the neural radiance field (NeRF) method. Such methods,…
3D ReconstructionNeRFM2GAN: A Multi-Stage Self-Attention Network for Image Rain Removal on Autonomous Vehicles
Image deraining is a new challenging problem in applications of autonomous vehicles. In a bad weather condition of heavy rainfall, raindrops, mainly hitting the vehicle's windshield, can significantly reduce observation …
Autonomous VehiclesGenerative Adversarial NetworkRain RemovalSemantic SegmentationA Linear Generalized Camera Calibration From Three Intersecting Reference Planes
This paper presents a new generalized (or ray-pixel, raxel) camera calibration algorithm for camera systems involving distortions by unknown refraction and reflection processes. The key idea is use of intersections of ca…
Camera Calibration