StereoVAE: A lightweight stereo-matching system using embedded GPUs
We present a lightweight system for stereo matching through embedded GPUs. It breaks the trade-off between accuracy and processing speed in stereo matching, enabling our embedded system to further improve the matching accuracy while ensuring real-time processing. The main idea of our method is to construct a tiny neural network based on variational auto-encoder (VAE) to upsample and refinement a small size of coarse disparity map, which is first generated by a traditional matching method. The proposed hybrid structure cannot only bring the advantage of traditional methods in terms of computational complexity, but also ensure the matching accuracy under the impact of neural network. Extensive experiments on the KITTI 2015 benchmark demonstrate that our tiny system exhibits high robustness in improving the accuracy of the coarse disparity maps generated by different algorithms, while also running in real-time on embedded GPUs.
Code (0)
등록된 구현이 없습니다.
Tasks
Stereo MatchingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Real-Time Semantic Stereo Matching
Scene understanding is paramount in robotics, self-navigation, augmented reality, and many other fields. To fully accomplish this task, an autonomous agent has to infer the 3D structure of the sensed scene (to know where…
Scene UnderstandingSemantic SegmentationStereo MatchingAttention Concatenation Volume for Accurate and Efficient Stereo Matching
Stereo matching is a fundamental building block for many vision and robotics applications. An informative and concise cost volume representation is vital for stereo matching of high accuracy and efficiency. In this paper…
Patch MatchingStereo Depth EstimationStereo MatchingMTStereo 2.0: improved accuracy of stereo depth estimation withMax-trees
Efficient yet accurate extraction of depth from stereo image pairs is required by systems with low power resources, such as robotics and embedded systems. State-of-the-art stereo matching methods based on convolutional n…
Depth EstimationGPUStereo Depth EstimationStereo MatchingLightweight Multi-Drone Detection and 3D-Localization via YOLO
In this work, we present and evaluate a method to perform real-time multiple drone detection and three-dimensional localization using state-of-the-art tiny-YOLOv4 object detection algorithm and stereo triangulation. Our …
object-detectionObject DetectionStereo MatchingEmbedded real-time stereo estimation via Semi-Global Matching on the GPU
Dense, robust and real-time computation of depth information from stereo-camera systems is a computationally demanding requirement for robotics, advanced driver assistance systems (ADAS) and autonomous vehicles. Semi-Glo…
Autonomous VehiclesDisparity EstimationGPU