Eventor: An Efficient Event-Based Monocular Multi-View Stereo Accelerator on FPGA Platform
Event cameras are bio-inspired vision sensors that asynchronously represent pixel-level brightness changes as event streams. Event-based monocular multi-view stereo (EMVS) is a technique that exploits the event streams to estimate semi-dense 3D structure with known trajectory. It is a critical task for event-based monocular SLAM. However, the required intensive computation workloads make it challenging for real-time deployment on embedded platforms. In this paper, Eventor is proposed as a fast and efficient EMVS accelerator by realizing the most critical and time-consuming stages including event back-projection and volumetric ray-counting on FPGA. Highly paralleled and fully pipelined processing elements are specially designed via FPGA and integrated with the embedded ARM as a heterogeneous system to improve the throughput and reduce the memory footprint. Meanwhile, the EMVS algorithm is reformulated to a more hardware-friendly manner by rescheduling, approximate computing and hybrid data quantization. Evaluation results on DAVIS dataset show that Eventor achieves up to $24\times$ improvement in energy efficiency compared with Intel i5 CPU platform.
Code (0)
등록된 구현이 없습니다.
Tasks
CPUQuantizationSimilar Papers 제목 키워드 기반
STS: Surround-view Temporal Stereo for Multi-view 3D Detection
Learning accurate depth is essential to multi-view 3D object detection. Recent approaches mainly learn depth from monocular images, which confront inherent difficulties due to the ill-posed nature of monocular depth lear…
3D Object DetectionDepth EstimationDepth Predictionobject-detection+3MVSAnywhere: Zero-Shot Multi-View Stereo
Computing accurate depth from multiple views is a fundamental and longstanding challenge in computer vision. However, most existing approaches do not generalize well across different domains and scene types (e.g. indoor …
Depth EstimationvalidScale-aware direct monocular odometry
We present a generic framework for scale-aware direct monocular odometry based on depth prediction from a deep neural network. In contrast with previous methods where depth information is only partially exploited, we for…
Depth EstimationDepth PredictionPredictionBridgeDepth: Bridging Monocular and Stereo Reasoning with Latent Alignment
Monocular and stereo depth estimation offer complementary strengths: monocular methods capture rich contextual priors but lack geometric precision, while stereo approaches leverage epipolar geometry yet struggle with amb…
Zero-shot GeneralizationStereo Depth EstimationStereo-Matching Knowledge Distilled Monocular Depth Estimation Filtered by Multiple Disparity Consistency
In stereo-matching knowledge distillation methods of the self-supervised monocular depth estimation, the stereo-matching network's knowledge is distilled into a monocular depth network through pseudo-depth maps. In these…
Depth EstimationKnowledge DistillationMonocular Depth EstimationStereo Matching