paper-with-me

홈 › Papers

RePLAy: Remove Projective LiDAR Depthmap Artifacts via Exploiting Epipolar Geometry

2024-07-27 · Shengjie Zhu, Girish Chandar Ganesan, Abhinav Kumar, Xiaoming Liu

3D sensing is a fundamental task for Autonomous Vehicles. Its deployment often relies on aligned RGB cameras and LiDAR. Despite meticulous synchronization and calibration, systematic misalignment persists in LiDAR projected depthmap. This is due to the physical baseline distance between the two sensors. The artifact is often reflected as background LiDAR incorrectly projected onto the foreground, such as cars and pedestrians. The KITTI dataset uses stereo cameras as a heuristic solution to remove artifacts. However most AV datasets, including nuScenes, Waymo, and DDAD, lack stereo images, making the KITTI solution inapplicable. We propose RePLAy, a parameter-free analytical solution to remove the projective artifacts. We construct a binocular vision system between a hypothesized virtual LiDAR camera and the RGB camera. We then remove the projective artifacts by determining the epipolar occlusion with the proposed analytical solution. We show unanimous improvement in the State-of-The-Art (SoTA) monocular depth estimators and 3D object detectors with the artifacts-free depthmaps.

📄 PDF Abstract BibTeX arXiv:2407.19154

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Vehicles

Similar Papers 제목 키워드 기반

Reflection Removal for Large-Scale 3D Point Clouds

2018-06-01 · CVPR 2018 6 · Jae-Seong Yun, Jae-Young Sim

Large-scale 3D point clouds (LS3DPCs) captured by terrestrial LiDAR scanners often exhibit reflection artifacts by glasses, which degrade the performance of related computer vision techniques. In this paper, we propose a…

Reflection Removalvalid

The Analysis of Projective Transformation Algorithms for Image Recognition on Mobile Devices

2019-12-03 · Anton Trusov, Elena Limonova

In this work we apply commonly known methods of non-adaptive interpolation (nearest pixel, bilinear, B-spline, bicubic, Hermite spline) and sampling (point sampling, supersampling, mip-map pre-filtering, rip-map pre-filt…

Refining the bounding volumes for lossless compression of voxelized point clouds geometry

2021-06-01 · Emre Can Kaya, Sebastian Schwarz, Ioan Tabus

This paper describes a novel lossless compression method for point cloud geometry, building on a recent lossy compression method that aimed at reconstructing only the bounding volume of a point cloud. The proposed scheme…

PlaneNet: Piece-wise Planar Reconstruction from a Single RGB Image

2018-04-17 · CVPR 2018 6 · Chen Liu, Jimei Yang, Duygu Ceylan, Ersin Yumer 외

This paper proposes a deep neural network (DNN) for piece-wise planar depthmap reconstruction from a single RGB image. While DNNs have brought remarkable progress to single-image depth prediction, piece-wise planar depth…

Depth EstimationDepth PredictionSegmentation

LiDAR-EDIT: LiDAR Data Generation by Editing the Object Layouts in Real-World Scenes

2024-11-30 · Shing-Hei Ho, Bao Thach, Minghan Zhu

We present LiDAR-EDIT, a novel paradigm for generating synthetic LiDAR data for autonomous driving. Our framework edits real-world LiDAR scans by introducing new object layouts while preserving the realism of the backgro…

Autonomous DrivingcounterfactualNovel View SynthesisObject+2