Unsupervised Learning of Depth Estimation and Visual Odometry for Sparse Light Field Cameras
While an exciting diversity of new imaging devices is emerging that could dramatically improve robotic perception, the challenges of calibrating and interpreting these cameras have limited their uptake in the robotics community. In this work we generalise techniques from unsupervised learning to allow a robot to autonomously interpret new kinds of cameras. We consider emerging sparse light field (LF) cameras, which capture a subset of the 4D LF function describing the set of light rays passing through a plane. We introduce a generalised encoding of sparse LFs that allows unsupervised learning of odometry and depth. We demonstrate the proposed approach outperforming monocular and conventional techniques for dealing with 4D imagery, yielding more accurate odometry and depth maps and delivering these with metric scale. We anticipate our technique to generalise to a broad class of LF and sparse LF cameras, and to enable unsupervised recalibration for coping with shifts in camera behaviour over the lifetime of a robot. This work represents a first step toward streamlining the integration of new kinds of imaging devices in robotics applications.
Code (0)
등록된 구현이 없습니다.
Tasks
Depth EstimationDiversityVisual OdometrySimilar Papers 제목 키워드 기반
Unsupervised Depth Completion from Visual Inertial Odometry
We describe a method to infer dense depth from camera motion and sparse depth as estimated using a visual-inertial odometry system. Unlike other scenarios using point clouds from lidar or structured light sensors, we hav…
Depth CompletionUnsupervised Learning of Monocular Depth Estimation and Visual Odometry with Deep Feature Reconstruction
Despite learning based methods showing promising results in single view depth estimation and visual odometry, most existing approaches treat the tasks in a supervised manner. Recent approaches to single view depth estima…
Depth And Camera MotionDepth EstimationDepth PredictionMonocular Depth Estimation+1Dense-depth map guided deep Lidar-Visual Odometry with Sparse Point Clouds and Images
Odometry is a critical task for autonomous systems for self-localization and navigation. We propose a novel LiDAR-Visual odometry framework that integrates LiDAR point clouds and images for accurate and robust pose estim…
Depth CompletionPose EstimationVisual OdometryPoint CloudsDeep Virtual Stereo Odometry: Leveraging Deep Depth Prediction for Monocular Direct Sparse Odometry
Monocular visual odometry approaches that purely rely on geometric cues are prone to scale drift and require sufficient motion parallax in successive frames for motion estimation and 3D reconstruction. In this paper, we …
3D ReconstructionDepth EstimationDepth PredictionMonocular Visual Odometry+2Recurrent Neural Network for (Un-)supervised Learning of Monocular VideoVisual Odometry and Depth
Deep learning-based, single-view depth estimation methods have recently shown highly promising results. However, such methods ignore one of the most important features for determining depth in the human vision system, wh…
Depth EstimationMULTI-VIEW LEARNINGVisual Odometry