paper-with-me

홈 › Papers

SD-6DoF-ICLK: Sparse and Deep Inverse Compositional Lucas-Kanade Algorithm on SE(3)

2021-03-30 · Timo Hinzmann, Roland Siegwart

This paper introduces SD-6DoF-ICLK, a learning-based Inverse Compositional Lucas-Kanade (ICLK) pipeline that uses sparse depth information to optimize the relative pose that best aligns two images on SE(3). To compute this six Degrees-of-Freedom (DoF) relative transformation, the proposed formulation requires only sparse depth information in one of the images, which is often the only available depth source in visual-inertial odometry or Simultaneous Localization and Mapping (SLAM) pipelines. In an optional subsequent step, the framework further refines feature locations and the relative pose using individual feature alignment and bundle adjustment for pose and structure re-alignment. The resulting sparse point correspondences with subpixel-accuracy and refined relative pose can be used for depth map generation, or the image alignment module can be embedded in an odometry or mapping framework. Experiments with rendered imagery show that the forward SD-6DoF-ICLK runs at 145 ms per image pair with a resolution of 752 x 480 pixels each, and vastly outperforms the classical, sparse 6DoF-ICLK algorithm, making it the ideal framework for robust image alignment under severe conditions.

📄 PDF Abstract BibTeX arXiv:2103.16528

Code (0)

등록된 구현이 없습니다.

Tasks

Simultaneous Localization and Mapping

Similar Papers 제목 키워드 기반

Deep UAV Localization with Reference View Rendering

2020-08-11 · Timo Hinzmann, Roland Siegwart

This paper presents a framework for the localization of Unmanned Aerial Vehicles (UAVs) in unstructured environments with the help of deep learning. A real-time rendering engine is introduced that generates optical and d…

Aligning Across Large Gaps in Time

2018-03-22 · Hunter Goforth, Simon Lucey

We present a method of temporally-invariant image registration for outdoor scenes, with invariance across time of day, across seasonal variations, and across decade-long periods, for low- and high-texture scenes. Our met…

3D ReconstructionImage Registration

CLKN: Cascaded Lucas-Kanade Networks for Image Alignment

2017-07-01 · CVPR 2017 7 · Che-Han Chang, Chun-Nan Chou, Edward Y. Chang

This paper proposes a data-driven approach for image alignment. Our main contribution is a novel network architecture that combines the strengths of convolutional neural networks (CNNs) and the Lucas-Kanade algorithm. Th…

Homography Estimation

Inverse Compositional Spatial Transformer Networks

2016-12-12 · CVPR 2017 7 · Chen-Hsuan Lin, Simon Lucey

In this paper, we establish a theoretical connection between the classical Lucas & Kanade (LK) algorithm and the emerging topic of Spatial Transformer Networks (STNs). STNs are of interest to the vision and learning comm…

ClassificationGeneral Classification

Proxy Templates for Inverse Compositional Photometric Bundle Adjustment

2017-04-23 · Christopher Ham, Simon Lucey, Surya Singh

Recent advances in 3D vision have demonstrated the strengths of photometric bundle adjustment. By directly minimizing reprojected pixel errors, instead of geometric reprojection errors, such methods can achieve sub-pixel…

CPU