NeuFlow v2: High-Efficiency Optical Flow Estimation on Edge Devices
Real-time high-accuracy optical flow estimation is crucial for various real-world applications. While recent learning-based optical flow methods have achieved high accuracy, they often come with significant computational costs. In this paper, we propose a highly efficient optical flow method that balances high accuracy with reduced computational demands. Building upon NeuFlow v1, we introduce new components including a much more light-weight backbone and a fast refinement module. Both these modules help in keeping the computational demands light while providing close to state of the art accuracy. Compares to other state of the art methods, our model achieves a 10x-70x speedup while maintaining comparable performance on both synthetic and real-world data. It is capable of running at over 20 FPS on 512x384 resolution images on a Jetson Orin Nano. The full training and evaluation code is available at https://github.com/neufieldrobotics/NeuFlow_v2.
Code (3)
Tasks
Optical Flow EstimationSimilar Papers 제목 키워드 기반
NeuFlow: Real-time, High-accuracy Optical Flow Estimation on Robots Using Edge Devices
Real-time high-accuracy optical flow estimation is a crucial component in various applications, including localization and mapping in robotics, object tracking, and activity recognition in computer vision. While recent l…
Activity RecognitionEdge-computingObject TrackingOptical Flow EstimationDeGraF-Flow: Extending DeGraF Features for accurate and efficient sparse-to-dense optical flow estimation
Modern optical flow methods make use of salient scene feature points detected and matched within the scene as a basis for sparse-to-dense optical flow estimation. Current feature detectors however either give sparse, non…
Computational EfficiencyGPUOptical Flow EstimationCSFlow: Learning Optical Flow via Cross Strip Correlation for Autonomous Driving
Optical flow estimation is an essential task in self-driving systems, which helps autonomous vehicles perceive temporal continuity information of surrounding scenes. The calculation of all-pair correlation plays an impor…
Autonomous DrivingAutonomous VehiclesOptical Flow EstimationST-FlowNet: An Efficient Spiking Neural Network for Event-Based Optical Flow Estimation
Spiking Neural Networks (SNNs) have emerged as a promising tool for event-based optical flow estimation tasks due to their ability to leverage spatio-temporal information and low-power capabilities. However, the performa…
Event-based Optical FlowOptical Flow EstimationEfficient Meshflow and Optical Flow Estimation from Event Cameras
In this paper we explore the problem of event-based meshflow estimation a novel task that involves predicting a spatially smooth sparse motion field from event cameras. To start we generate a large-scale High-Resolut…
DecoderOptical Flow Estimation