Extrinsic Camera Calibration with Semantic Segmentation
Monocular camera sensors are vital to intelligent vehicle operation and automated driving assistance and are also heavily employed in traffic control infrastructure. Calibrating the monocular camera, though, is time-consuming and often requires significant manual intervention. In this work, we present an extrinsic camera calibration approach that automatizes the parameter estimation by utilizing semantic segmentation information from images and point clouds. Our approach relies on a coarse initial measurement of the camera pose and builds on lidar sensors mounted on a vehicle with high-precision localization to capture a point cloud of the camera environment. Afterward, a mapping between the camera and world coordinate spaces is obtained by performing a lidar-to-camera registration of the semantically segmented sensor data. We evaluate our method on simulated and real-world data to demonstrate low error measurements in the calibration results. Our approach is suitable for infrastructure sensors as well as vehicle sensors, while it does not require motion of the camera platform.
Code (1)
Tasks
Camera Calibrationparameter estimationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Cross-view Transformers for real-time Map-view Semantic Segmentation
We present cross-view transformers, an efficient attention-based model for map-view semantic segmentation from multiple cameras. Our architecture implicitly learns a mapping from individual camera views into a canonical …
Bird's-Eye View Semantic SegmentationSegmentationSemantic SegmentationGround Plane-Aided Extrinsic Calibration of Inertial and RGB-D Sensors for Uncrewed Aerial Vehicles
Accurate extrinsic calibration of inertial sensors, such as Inertial Measurement Units (IMUs) and cameras is crucial for trajectory estimation of Uncrewed Aerial Vehicles (UAVs). While numerous calibration methods have b…
Calib-Anything: Zero-training LiDAR-Camera Extrinsic Calibration Method Using Segment Anything
The research on extrinsic calibration between Light Detection and Ranging(LiDAR) and camera are being promoted to a more accurate, automatic and generic manner. Since deep learning has been employed in calibration, the r…
Camera CalibrationLearning Markerless Robot-Depth Camera Calibration and End-Effector Pose Estimation
Traditional approaches to extrinsic calibration use fiducial markers and learning-based approaches rely heavily on simulation data. In this work, we present a learning-based markerless extrinsic calibration system that u…
Camera CalibrationKeypoint DetectionOutlier DetectionPose EstimationContinuous Online Extrinsic Calibration of Fisheye Camera and LiDAR
Automated driving systems use multi-modal sensor suites to ensure the reliable, redundant and robust perception of the operating domain, for example camera and LiDAR. An accurate extrinsic calibration is required to fuse…
Depth EstimationMonocular Depth Estimation