Y-GAN: A Generative Adversarial Network for Depthmap Estimation from Multi-camera Stereo Images
Depth perception is a key component for autonomous systems that interact in the real world, such as delivery robots, warehouse robots, and self-driving cars. Tasks in autonomous robotics such as 3D object recognition, simultaneous localization and mapping (SLAM), path planning and navigation, require some form of 3D spatial information. Depth perception is a long-standing research problem in computer vision and robotics and has had a long history. Many approaches using deep learning, ranging from structure from motion, shape-from-X, monocular, binocular, and multi-view stereo, have yielded acceptable results. However, there are several shortcomings of these methods such as requiring expensive hardware, needing supervised training data, no ground truth data for comparison, and disregard for occlusion. In order to address these shortcomings, this work proposes a new deep convolutional generative adversarial network architecture, called Y-GAN, that uses data from three cameras to estimate a depth map for each frame in a multi-camera video stream.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Object RecognitionGenerative Adversarial NetworkObject RecognitionSelf-Driving CarsSimultaneous Localization and MappingSimilar Papers 제목 키워드 기반
Revisit Self-supervised Depth Estimation with Local Structure-from-Motion
Both self-supervised depth estimation and Structure-from-Motion (SfM) recover scene depth from RGB videos. Despite sharing a similar objective, the two approaches are disconnected. Prior works of self-supervision backpro…
Depth EstimationNeRFRePLAy: Remove Projective LiDAR Depthmap Artifacts via Exploiting Epipolar Geometry
3D sensing is a fundamental task for Autonomous Vehicles. Its deployment often relies on aligned RGB cameras and LiDAR. Despite meticulous synchronization and calibration, systematic misalignment persists in LiDAR projec…
Autonomous VehiclesPatchMatch Based Joint View Selection and Depthmap Estimation
We propose a multi-view depthmap estimation approach aimed at adaptively ascertaining the pixel level data associations between a reference image and all the elements of a source image set. Namely, we address the questio…
GPUPlaneNet: Piece-wise Planar Reconstruction from a Single RGB Image
This paper proposes a deep neural network (DNN) for piece-wise planar depthmap reconstruction from a single RGB image. While DNNs have brought remarkable progress to single-image depth prediction, piece-wise planar depth…
Depth EstimationDepth PredictionSegmentationSparse Representations for Object and Ego-motion Estimation in Dynamic Scenes
Dynamic scenes that contain both object motion and egomotion are a challenge for monocular visual odometry (VO). Another issue with monocular VO is the scale ambiguity, i.e. these methods cannot estimate scene depth and …
Depth And Camera MotionMonocular Visual OdometryMotion EstimationObject+3